vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #444
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.WTmefKftvm', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 3020990a-2e69-4677-996e-1072075476f716(finished: start all VMs, in 75.81 seconds)17gitlab # Superblock backups stored on blocks:18gitlab: waiting for unit setup-gitlab.service19gitlab # 32768, 98304, 163840, 22937620gitlab: waiting for the VM to finish booting21gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zdqa56g7h6bm8m7aavsl0slmmqxks1cd-nixos-system-gitlab-test/init regInfo=/nix/store/wxim4k5gyjipxc2cbp0c013rhgp0wkza-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/wxim4k5gyjipxc2cbp0c013rhgp0wkza-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000032] arm-pv: using stolen time PV108gitlab # [ 0.000394] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000594] Console: colour dummy device 80x25110gitlab # [ 0.000602] printk: legacy console [tty0] enabled111gitlab # [ 0.000790] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000796] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000879] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001027] landlock: Up and running.115gitlab # [ 0.001030] Yama: becoming mindful.116gitlab # [ 0.001473] LSM support for eBPF active117gitlab # [ 0.001715] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001832] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003049] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003804] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003808] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003968] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005055] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005152] EFI services will not be available.125gitlab # [ 0.005329] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005821] Detected PIPT I-cache on CPU1127gitlab # [ 0.005858] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005898] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005938] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007102] Detected PIPT I-cache on CPU2131gitlab # [ 0.007142] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007183] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007225] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.007942] Detected PIPT I-cache on CPU3135gitlab # [ 0.007977] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008015] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008053] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.008266] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.008296] SMP: Total of 4 processors activated.140gitlab # [ 0.008298] CPU: All CPU(s) started at EL1141gitlab # [ 0.008316] CPU features: detected: Branch Target Identification142gitlab # [ 0.008319] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.008322] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.008325] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.008329] CPU features: detected: Common not Private translations146gitlab # [ 0.008332] CPU features: detected: CRC32 instructions147gitlab # [ 0.008334] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.008337] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.008340] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.008342] CPU features: detected: E0PD151gitlab # [ 0.008345] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.008348] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.008350] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.008353] CPU features: detected: Fine Grained Traps155gitlab # [ 0.008356] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.008360] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.008362] CPU features: detected: LSE atomic instructions158gitlab # [ 0.008365] CPU features: detected: Privileged Access Never159gitlab # [ 0.008367] CPU features: detected: PMUv3160gitlab # [ 0.008369] CPU features: detected: RAS Extension Support161gitlab # [ 0.008371] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.008374] CPU features: detected: Random Number Generator163gitlab # [ 0.008376] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.008379] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.008381] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.008385] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.008495] alternatives: applying system-wide alternatives168gitlab # [ 0.011500] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.011796] Memory: 5963788K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013857] devtmpfs: initialized171gitlab # [ 0.017128] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017203] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.017385] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.017390] 0 pages in range for non-PLT usage175gitlab # [ 0.017392] 508288 pages in range for PLT usage176gitlab # [ 0.017511] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018363] DMI not present or invalid.178gitlab # [ 0.021802] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024401] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024655] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026617] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026641] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026826] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027316] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027318] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027323] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027325] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027328] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027383] cpuidle: using governor ladder190gitlab # [ 0.027420] cpuidle: using governor menu191gitlab # [ 0.027762] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027926] ASID allocator initialised with 65536 entries193gitlab # [ 0.029088] Serial: AMBA PL011 UART driver194gitlab # [ 0.034305] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034593] printk: console [ttyAMA0] enabled196gitlab # [ 0.040309] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.040324] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.040329] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.040333] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.040338] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.040342] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.040346] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.040350] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.047707] fbcon: Taking over console205gitlab # [ 0.047719] ACPI: Interpreter disabled.206gitlab # [ 0.048719] iommu: Default domain type: Translated207gitlab # [ 0.048729] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.062704] SCSI subsystem initialized209gitlab # [ 0.063364] usbcore: registered new interface driver usbfs210gitlab # [ 0.063432] usbcore: registered new interface driver hub211gitlab # [ 0.063473] usbcore: registered new device driver usb212gitlab # [ 0.064100] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.064107] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.064138] PTP clock support registered215gitlab # [ 0.064198] EDAC MC: Ver: 3.0.0216gitlab # [ 0.064729] scmi_core: SCMI protocol bus registered217gitlab # [ 0.065524] FPGA manager framework218gitlab # [ 0.067148] vgaarb: loaded219gitlab # [ 0.067834] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.071297] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.071339] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.071873] netfs: FS-Cache loaded223gitlab # [ 0.072031] pnp: PnP ACPI: disabled224gitlab # [ 0.078451] NET: Registered PF_INET protocol family225gitlab # [ 0.079984] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.122354] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.122430] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.122501] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.122916] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.123709] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.123930] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.124010] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.124168] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.124459] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.124542] NET: Registered PF_XDP protocol family236gitlab # [ 0.124573] PCI: CLS 0 bytes, default 64237gitlab # [ 0.124767] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.132167] kvm [1]: HYP mode not available239gitlab # [ 0.197310] Initialise system trusted keyrings240gitlab # [ 0.197622] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.200386] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.203918] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.221461] Key type asymmetric registered244gitlab # [ 0.221469] Asymmetric key parser 'x509' registered245gitlab # [ 0.221541] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.221775] io scheduler mq-deadline registered247gitlab # [ 0.221785] io scheduler kyber registered248gitlab # [ 0.230169] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.232329] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.232886] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.232906] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.232920] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.232929] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.232965] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.232993] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.233117] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.233127] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.233133] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.233138] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.233142] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.233297] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.234098] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.234434] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.234453] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.234496] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.234516] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.235343] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.235687] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.235706] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.235749] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.236591] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.236922] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.236941] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.236990] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.237812] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.238161] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.238179] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.238229] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.239064] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.239410] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.239430] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.239473] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.240412] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.240785] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.240811] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.240852] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.241736] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.242064] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.242089] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.242131] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.242157] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.243055] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.243406] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.243454] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.244321] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.244679] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.244724] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.245475] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.245807] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.246260] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.246707] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.246728] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.246777] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.247645] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.248024] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.248043] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.248093] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.249135] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.249145] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.249151] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.249239] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.249325] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.249407] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.249493] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.249582] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.249657] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.249744] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.249833] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.249913] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.250023] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.250102] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.250139] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.250175] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.250206] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.250242] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.250273] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.250304] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.250335] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.250366] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.250397] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.250435] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.250466] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.250495] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.250530] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.250560] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.250589] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.250619] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.250657] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.250688] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.250718] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.250748] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.250785] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.250794] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.250798] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.253112] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.273062] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.276719] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.280854] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.284822] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.288887] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.292284] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.295806] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.301357] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.305216] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.308395] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.313633] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.323006] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.326399] msm_serial: driver initialized359gitlab # [ 0.326632] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.326714] STM32 USART driver initialized361gitlab # [ 0.375195] loop: module loaded362gitlab # [ 0.375700] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.378659] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.381594] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.384174] virtio_blk virtio5: [vdb] 12395432 512-byte logical blocks (6.35 GB/5.91 GiB)366gitlab # [ 0.387060] megasas: 07.734.00.00-rc1367gitlab # [ 0.388135] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.406003] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.406110] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.408715] Using buffer write method371gitlab # [ 0.408776] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.411627] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.411656] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.414318] Using buffer write method375gitlab # [ 0.414345] Concatenating MTD devices:376gitlab # [ 0.414348] (0): "0.flash"377gitlab # [ 0.414352] (1): "0.flash"378gitlab # [ 0.414354] into device "0.flash"379gitlab # [ 0.615068] Freeing initrd memory: 27184K380gitlab # [ 0.625163] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.629997] thunder_xcv, ver 1.0382gitlab # [ 0.630058] thunder_bgx, ver 1.0383gitlab # [ 0.630103] nicpf, ver 1.0384gitlab # [ 0.631023] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.631029] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.631066] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.631074] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.631115] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.631119] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.631164] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.631169] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.631372] sky2: driver version 1.30393gitlab # [ 0.634030] usbcore: registered new interface driver usb-storage394gitlab # [ 0.634190] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.634243] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.634259] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.634283] usbserial: USB Serial support registered for generic398gitlab # [ 0.634681] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.635204] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.636834] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.636866] rtc-pl031 9010000.pl031: setting system clock to 2026-10-10T10:44:37 UTC (1791629077)402gitlab # [ 0.637348] i2c_dev: i2c /dev entries driver403gitlab # [ 0.641683] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.641690] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.642102] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.642701] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.643891] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00408gitlab # [ 0.644696] hub 1-0:1.0: USB hub found409gitlab # [ 0.644719] hub 1-0:1.0: 6 ports detected410gitlab # [ 0.645317] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.645771] usbcore: registered new interface driver usbhid412gitlab # [ 0.645777] usbhid: USB HID core driver413gitlab # [ 0.652662] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.655093] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.655335] NET: Registered PF_INET6 protocol family416gitlab # [ 0.656492] Segment Routing with IPv6417gitlab # [ 0.656510] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.656546] NET: Registered PF_PACKET protocol family419gitlab # [ 0.656728] 9pnet: Installing 9P2000 support420gitlab # [ 0.659079] Key type dns_resolver registered421gitlab # [ 0.668946] registered taskstats version 1422gitlab # [ 0.669402] Loading compiled-in X.509 certificates423gitlab # [ 0.684274] Demotion targets for Node 0: null424gitlab # [ 0.684576] Key type .fscrypt registered425gitlab # [ 0.684581] Key type fscrypt-provisioning registered426gitlab # [ 0.684798] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.684818] ima: Allocated hash algorithm: sha1428gitlab # [ 0.684855] ima: No architecture policies found429gitlab # [ 0.685842] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.710778] clk: Disabling unused clocks431gitlab # [ 0.710817] PM: genpd: Disabling unused power domains432gitlab # [ 0.715587] Freeing unused kernel memory: 4736K433gitlab # [ 0.715898] Run /init as init process434gitlab # [ 0.756538] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.895879] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.047764] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.090899] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.090938] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.090982] systemd[1]: Detected architecture arm64.440gitlab # [ 1.090990] systemd[1]: Running in initrd.441gitlab # [ 1.091542] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.091689] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.160200] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.279927] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.289503] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.358022] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.383504] systemd[1]: Created slice Slice /system/modprobe.448gitlab # [ 1.383990] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.449gitlab # [ 1.384034] systemd[1]: Expecting device /dev/disk/by-label/nix-store...450gitlab # [ 1.384049] systemd[1]: Expecting device /dev/disk/by-label/nixos...451gitlab # [ 1.384077] systemd[1]: Reached target Path Units.452gitlab # [ 1.384095] systemd[1]: Reached target Slice Units.453gitlab # [ 1.384116] systemd[1]: Reached target Swaps.454gitlab # [ 1.384136] systemd[1]: Reached target Timer Units.455gitlab # [ 1.384396] systemd[1]: Listening on D-Bus System Message Bus Socket.456gitlab # [ 1.384585] systemd[1]: Listening on Journal Socket (/dev/log).457gitlab # [ 1.384752] systemd[1]: Listening on Journal Sockets.458gitlab # [ 1.384910] systemd[1]: Listening on udev Control Socket.459gitlab # [ 1.385009] systemd[1]: Listening on udev Kernel Socket.460gitlab # [ 1.385030] systemd[1]: Reached target Socket Units.461gitlab # [ 1.387121] systemd[1]: Starting Create List of Static Device Nodes...462gitlab # [ 1.389252] systemd[1]: Starting Load Kernel Module 9pnet_virtio...463gitlab # [ 1.389345] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs464gitlab # [ 1.391450] systemd[1]: Mounting Kernel Configuration File System...465gitlab # [ 1.408291] systemd[1]: Starting Journal Service...466gitlab # [ 1.410900] systemd[1]: Starting Load Kernel Modules...467gitlab # [ 1.411104] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os468gitlab # [ 1.413351] systemd[1]: Starting Coldplug All udev Devices...469gitlab # [ 1.415631] systemd[1]: Finished Create List of Static Device Nodes.470gitlab # [ 1.425845] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.471gitlab # [ 1.428266] systemd[1]: Finished Load Kernel Module 9pnet_virtio.472gitlab # [ 1.430609] systemd[1]: Mounted Kernel Configuration File System.473gitlab # [ 1.433883] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2474gitlab # [ 1.434146] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0475gitlab # [ 1.444403] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.453739] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.454044] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.454049] [drm] features: -context_init479gitlab # [ 1.455026] [drm] number of scanouts: 1480gitlab # [ 1.455042] [drm] number of cap sets: 0481gitlab # [ 1.455613] systemd-journald[94]: Collecting audit messages is disabled.482gitlab # [ 1.455770] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic483gitlab # [ 1.455782] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0484gitlab # [ 1.462732] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.485gitlab # [ 1.463084] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.486gitlab # [ 1.468025] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev487gitlab # [ 1.468303] Console: switching to colour frame buffer device 160x50488gitlab # [ 1.474039] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device489gitlab # [ 1.475557] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.496248] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.499455] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.510313] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.510848] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.511450] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.517254] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.524101] systemd[1]: Started Journal Service.497gitlab # [ 1.520853] systemd-modules-load[95]: Using 4 probe threads498gitlab # [ 1.525651] systemd-modules-load[95]: Module 'virtio_balloon' is built in499gitlab # [ 1.527003] systemd-modules-load[95]: Module 'virtio_console' is built in500gitlab # [ 1.528343] systemd-modules-load[95]: Module 'virtio_rng' is built in501gitlab # [ 1.529460] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.531137] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.532335] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.534048] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.553588] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.556912] systemd-udevd[108]: Using default interface naming scheme 'v261'.507gitlab # [ 1.575320] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.601861] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.646242] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.649076] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.047521] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.049189] systemd[1]: Reached target System Initialization.513gitlab # [ 2.050581] systemd[1]: Reached target Basic System.514gitlab # [ 2.169496] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.194290] systemd[1]: Found device /dev/disk/by-label/nix-store.516gitlab # [ 2.197529] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.517gitlab # [ 2.207922] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.223790] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.227180] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.271492] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks521gitlab # [ 2.276415] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.522gitlab # [ 2.412617] systemd[1]: Mounting /sysroot...523gitlab # [ 2.448197] EXT4-fs (vda): mounted filesystem 3020990a-2e69-4677-996e-1072075476f7 r/w with ordered data mode. Quota mode: none.524gitlab # [ 2.446385] systemd[1]: Mounted /sysroot.525gitlab # [ 2.447928] systemd[1]: Reached target Initrd Root File System.526gitlab # [ 2.452542] systemd[1]: Mounting /sysroot/nix/.ro-store...527gitlab # [ 2.454866] systemd[1]: Mounting /sysroot/nix/.rw-store...528gitlab # [ 2.460364] systemd[1]: Mounting /sysroot/run...529gitlab # [ 2.484603] systemd[1]: Mounting /sysroot/tmp/shared...530gitlab # [ 2.501020] systemd[1]: Mounting /sysroot/tmp/xchg...531gitlab # [ 2.505633] erofs (device vdb): mounted with root inode @ nid 128.532gitlab # [ 2.502091] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.507022] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.509448] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.510144] systemd[1]: Mounted /sysroot/nix/.ro-store.536gitlab # [ 2.511249] systemd-sysroot-fstab-check[168]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.514926] systemd[1]: Mounted /sysroot/tmp/xchg.538gitlab # [ 2.516038] systemd[1]: Reload requested from client PID 168 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 2.518526] systemd[1]: Reloading...540gitlab # [ 2.614090] systemd[1]: Reloading finished in 98 ms.541gitlab # [ 2.664691] systemd-sysroot-fstab-check[168]: Requesting initrd-fs.target/start/replace...542gitlab # [ 2.666988] systemd[1]: Mounted /sysroot/tmp/shared.543gitlab # [ 2.671508] systemd-sysroot-fstab-check[168]: Requesting swap.target/start/replace...544gitlab # [ 2.673578] systemd[1]: Starting rw-sysroot-nix-store.service...545gitlab # [ 2.677068] systemd[1]: initrd-parse-etc.service: Deactivated successfully.546gitlab # [ 2.689221] systemd[1]: Finished Mountpoints Configured in the Real Root.547gitlab # [ 2.692550] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.548gitlab # [ 2.698271] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.549gitlab # [ 2.700104] systemd[1]: Finished rw-sysroot-nix-store.service.550gitlab # [ 2.736911] (udev-worker)[119]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory551gitlab # [ 2.740336] (udev-worker)[119]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory552gitlab # [ 2.747902] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.553gitlab # [ 2.749430] systemd[1]: Stopped Virtual Console Setup.554gitlab # [ 2.750343] systemd[1]: Stopping Virtual Console Setup...555gitlab # [ 2.751157] systemd[1]: Starting Virtual Console Setup...556gitlab # [ 2.781162] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.782448] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.783372] systemd[1]: Starting Virtual Console Setup...559gitlab # [ 2.808570] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones.560gitlab # [ 2.811282] systemd[1]: Finished Virtual Console Setup.561gitlab # [ 3.415357] systemd[1]: Mounting /sysroot/nix/store...562gitlab # [ 3.462954] systemd[1]: Mounted /sysroot/nix/store.563gitlab # [ 3.464326] systemd[1]: Reached target Initrd File Systems.564gitlab # [ 3.465793] systemd[1]: Starting Find NixOS closure...565gitlab # [ 3.468335] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...566gitlab # [ 3.514780] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.567gitlab # [ 3.517194] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.568gitlab # [ 3.527446] systemd[1]: Finished Find NixOS closure.569gitlab # [ 3.528989] systemd[1]: Reached target Initrd Default Target.570gitlab # [ 3.530424] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...571gitlab # [ 3.557413] systemd[1]: Stopped target Initrd Default Target.572gitlab # [ 3.558931] systemd[1]: Stopped target Basic System.573gitlab # [ 3.560260] systemd[1]: Stopped target Initrd Root Device.574gitlab # [ 3.561628] systemd[1]: Stopped target Path Units.575gitlab # [ 3.562862] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.576gitlab # [ 3.564843] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.577gitlab # [ 3.566710] systemd[1]: Stopped target Slice Units.578gitlab # [ 3.567970] systemd[1]: Stopped target Socket Units.579gitlab # [ 3.569246] systemd[1]: Stopped target System Initialization.580gitlab # [ 3.570675] systemd[1]: Stopped target Swaps.581gitlab # [ 3.571863] systemd[1]: Stopped target Timer Units.582gitlab # [ 3.574056] systemd[1]: dbus.socket: Deactivated successfully.583gitlab # [ 3.575430] systemd[1]: Closed D-Bus System Message Bus Socket.584gitlab # [ 3.580957] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.585gitlab # [ 3.582836] systemd[1]: Stopped Find NixOS closure.586gitlab # [ 3.584040] systemd[1]: Starting Load Kernel Module 9pnet_virtio...587gitlab # [ 3.585498] systemd[1]: Starting rw-sysroot-nix-store.service...588gitlab # [ 3.586868] systemd[1]: systemd-sysctl.service: Deactivated successfully.589gitlab # [ 3.588540] systemd[1]: Stopped Apply Kernel Variables.590gitlab # [ 3.589814] systemd[1]: systemd-modules-load.service: Deactivated successfully.591gitlab # [ 3.591788] systemd[1]: Stopped Load Kernel Modules.592gitlab # [ 3.593196] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.593gitlab # [ 3.594988] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.594gitlab # [ 3.597083] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.595gitlab # [ 3.598730] systemd[1]: Stopped Create System Files and Directories.596gitlab # [ 3.600152] systemd[1]: Stopped target Local File Systems.597gitlab # [ 3.601342] systemd[1]: Stopped target Preparation for Local File Systems.598gitlab # [ 3.602832] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.599gitlab # [ 3.604463] systemd[1]: Stopped Coldplug All udev Devices.600gitlab # [ 3.605580] systemd[1]: Stopping Rule-based Manager for Device Events and Files...601gitlab # [ 3.607050] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.602gitlab # [ 3.608594] systemd[1]: Stopped Virtual Console Setup.603gitlab # [ 3.609630] systemd[1]: initrd-cleanup.service: Deactivated successfully.604gitlab # [ 3.610941] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.605gitlab # [ 3.612289] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.606gitlab # [ 3.613701] systemd[1]: Finished Load Kernel Module 9pnet_virtio.607gitlab # [ 3.614924] systemd[1]: systemd-udevd.service: Deactivated successfully.608gitlab # [ 3.616431] systemd[1]: Stopped Rule-based Manager for Device Events and Files.609gitlab # [ 3.617844] systemd[1]: systemd-udevd.service: Consumed 2.032s CPU time over 2.088s wall clock time, 31.8M memory peak.610gitlab # [ 3.619926] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.611gitlab # [ 3.621461] systemd[1]: Finished rw-sysroot-nix-store.service.612gitlab # [ 3.622628] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.613gitlab # [ 3.624088] systemd[1]: Closed udev Control Socket.614gitlab # [ 3.625099] systemd[1]: Starting Cleanup udev Database...615gitlab # [ 3.626179] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.616gitlab # [ 3.627666] systemd[1]: Stopped Create Static Device Nodes in /dev.617gitlab # [ 3.628993] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.618gitlab # [ 3.630504] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.619gitlab # [ 3.631854] systemd[1]: kmod-static-nodes.service: Deactivated successfully.620gitlab # [ 3.633201] systemd[1]: Stopped Create List of Static Device Nodes.621gitlab # [ 3.664193] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.622gitlab # [ 3.665940] systemd[1]: Finished Cleanup udev Database.623gitlab # [ 3.667134] systemd[1]: Reached target Switch Root.624gitlab # [ 3.668479] systemd[1]: Starting NixOS Activation...625gitlab # [ 3.793979] initrd-nixos-activation-start[221]: booting system configuration /nix/store/zdqa56g7h6bm8m7aavsl0slmmqxks1cd-nixos-system-gitlab-test626gitlab # [ 3.835963] initrd-nixos-activation-start[221]: running activation script...627gitlab # [ 4.078230] initrd-nixos-activation-start[244]: setting up /etc...628gitlab # [ 4.200515] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.629gitlab # [ 4.202400] systemd[1]: Finished NixOS Activation.630gitlab # [ 4.203533] systemd[1]: Starting Switch Root...631gitlab # [ 4.245788] systemd[1]: Switching root.632gitlab # [ 4.366651] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).633gitlab # [ 4.936033] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)634gitlab # [ 4.936116] systemd[1]: Detected virtualization qemu.635gitlab # [ 4.936178] systemd[1]: Detected architecture arm64.636gitlab # [ 4.936301] systemd[1]: Detected first boot.637gitlab # [ 4.937152] systemd[1]: Initializing machine ID from random generator.638gitlab # [ 5.128745] systemd[1]: bpf-restrict-fs: LSM BPF program attached639gitlab # [ 5.216319] systemd[1]: Applying preset policy.640gitlab # [ 5.407304] systemd[1]: Populated /etc with preset unit settings.641gitlab # [ 5.590983] systemd[1]: initrd-switch-root.service: Deactivated successfully.642gitlab # [ 5.592284] systemd[1]: Stopped initrd-switch-root.service.643gitlab # [ 5.595058] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.644gitlab # [ 5.598198] systemd[1]: Created slice Slice /system/getty.645gitlab # [ 5.600482] systemd[1]: Created slice GitLab DevOps Platform Slice.646gitlab # [ 5.602777] systemd[1]: Created slice User and Session Slice.647gitlab # [ 5.603660] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.648gitlab # [ 5.605114] systemd[1]: Started Forward Password Requests to Wall Directory Watch.649gitlab # [ 5.605712] systemd[1]: Expecting device /dev/hvc0...650gitlab # [ 5.606105] systemd[1]: Expecting device /dev/ttyAMA0...651gitlab # [ 5.606487] systemd[1]: Reached target Local Encrypted Volumes.652gitlab # [ 5.606900] systemd[1]: Stopped target initrd-fs.target.653gitlab # [ 5.607274] systemd[1]: Stopped target initrd-root-fs.target.654gitlab # [ 5.607734] systemd[1]: Stopped target initrd-switch-root.target.655gitlab # [ 5.608333] systemd[1]: Reached target Virtual Machines and Containers.656gitlab # [ 5.608983] systemd[1]: Reached target Path Units.657gitlab # [ 5.609622] systemd[1]: Reached target Remote File Systems.658gitlab # [ 5.610241] systemd[1]: Reached target Slice Units.659gitlab # [ 5.610885] systemd[1]: Reached target Swaps.660gitlab # [ 5.613226] systemd[1]: Listening on Query the User Interactively for a Password.661gitlab # [ 5.615695] systemd[1]: Listening on Process Core Dump Socket.662gitlab # [ 5.617448] systemd[1]: Listening on Credential Encryption/Decryption.663gitlab # [ 5.619405] systemd[1]: Listening on Factory Reset Management.664gitlab # [ 5.620205] systemd[1]: Listening on Hostname Service Socket.665gitlab # [ 5.625543] systemd[1]: Starting Journal Log Access Socket...666gitlab # [ 5.626881] systemd[1]: Listening on Journal Audit Socket.667gitlab # [ 5.629251] systemd[1]: Listening on Console Output Muting Service Socket.668gitlab # [ 5.629947] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.669gitlab # [ 5.630389] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os670gitlab # [ 5.630751] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki671gitlab # [ 5.634414] systemd[1]: Listening on Disk Repartitioning Service Socket.672gitlab # [ 5.635336] systemd[1]: Listening on udev Control Socket.673gitlab # [ 5.636366] systemd[1]: Listening on udev Varlink Socket.674gitlab # [ 5.655308] systemd[1]: Mounting Huge Pages File System...675gitlab # [ 5.658703] systemd[1]: Mounting POSIX Message Queue File System...676gitlab # [ 5.662679] systemd[1]: Mounting Kernel Debug File System...677gitlab # [ 5.666453] systemd[1]: Mounting Kernel Trace File System...678gitlab # [ 5.672602] systemd[1]: Starting Create List of Static Device Nodes...679gitlab # [ 5.676737] systemd[1]: Starting Load Kernel Module 9pnet_virtio...680gitlab # [ 5.677483] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs681gitlab # [ 5.683193] systemd[1]: Mounting Kernel Configuration File System...682gitlab # [ 5.684152] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm683gitlab # [ 5.684850] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore684gitlab # [ 5.690666] systemd[1]: Starting Load Kernel Module fuse...685gitlab # [ 5.691396] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67686gitlab # [ 5.701396] systemd[1]: Starting Journal Service...687gitlab # [ 5.704935] systemd[1]: Starting Load Kernel Modules...688gitlab # [ 5.721010] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...689gitlab # [ 5.732779] systemd[1]: Starting Remount Root and Kernel File Systems...690gitlab # [ 5.734377] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os691gitlab # [ 5.749213] systemd[1]: Starting Coldplug All udev Devices...692gitlab # [ 5.758504] systemd-journald[315]: Collecting audit messages is enabled.693gitlab # [ 5.758556] fuse: init (API version 7.45)694gitlab # [ 5.759250] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 5.760077] systemd[1]: Mounted Huge Pages File System.696gitlab # [ 5.760732] systemd[1]: Mounted POSIX Message Queue File System.697gitlab # [ 5.761224] systemd[1]: Mounted Kernel Debug File System.698gitlab # [ 5.761688] systemd[1]: Mounted Kernel Trace File System.699gitlab # [ 5.762570] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 5.763412] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 5.764178] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 5.764886] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 5.765644] systemd[1]: modprobe@fuse.service: Deactivated successfully.704gitlab # [ 5.766427] systemd[1]: Finished Load Kernel Module fuse.705gitlab # [ 5.767353] systemd[1]: Finished Load Kernel Modules.706gitlab # [ 5.772801] systemd[1]: Mounting FUSE Control File System...707gitlab # [ 5.776953] systemd[1]: Starting Firewall...708gitlab # [ 5.788536] EXT4-fs (vda): re-mounted 3020990a-2e69-4677-996e-1072075476f7.709gitlab # [ 5.786726] systemd[1]: Queued start job for default target Multi-User System.710gitlab # [ 5.791391] systemd[1]: Starting Apply Kernel Variables...711gitlab # [ 5.790079] systemd[1]: Unnecessary job was removed for /dev/vdb.712gitlab # [ 5.794005] systemd[1]: systemd-journald.service: Deactivated successfully.713gitlab # [ 5.799316] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...714gitlab # [ 5.803526] systemd[1]: Started Journal Service.715gitlab # [ 5.796691] systemd-modules-load[316]: Using 3 probe threads716gitlab # [ 5.803982] systemd-modules-load[316]: Module 'atkbd' is built in717gitlab # [ 5.808436] systemd-modules-load[316]: Module 'loop' is built in718gitlab # [ 5.812783] systemd-modules-load[316]: Inserted module 'tls'719gitlab # [ 5.815674] systemd[1]: Finished Remount Root and Kernel File Systems.720gitlab # [ 5.820180] systemd[1]: Listening on Disk Image Download Service Socket.721gitlab # [ 5.827173] systemd[1]: Starting Flush Journal to Persistent Storage...722gitlab # [ 5.831438] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore723gitlab # [ 5.836577] systemd[1]: Starting Load/Save OS Random Seed...724gitlab # [ 5.844169] systemd-journald[315]: Received client request to flush runtime journal.725gitlab # [ 5.871295] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os726gitlab # [ 5.874870] systemd[1]: Mounted FUSE Control File System.727gitlab # [ 5.876330] systemd[1]: Finished Apply Kernel Variables.728gitlab # [ 5.878079] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.729gitlab # [ 5.880268] systemd[1]: Starting Create Static Device Nodes in /dev...730gitlab # [ 5.881769] systemd-oomd[317]: No swap; memory pressure usage will be degraded731gitlab # [ 5.883365] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.732gitlab # [ 5.884720] systemd[1]: Finished Flush Journal to Persistent Storage.733gitlab # [ 5.885702] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 5.887004] systemd[1]: Finished Create Static Device Nodes in /dev.735gitlab # [ 5.887982] systemd[1]: Reached target First Boot Complete.736gitlab # [ 5.888844] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 5.891407] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 5.947816] systemd-udevd[363]: Using default interface naming scheme 'v261'.739gitlab # [ 5.982171] systemd[1]: Started Rule-based Manager for Device Events and Files.740gitlab # [ 6.190486] systemd[1]: Finished Firewall.741gitlab # [ 6.402875] systemd[1]: Finished Coldplug All udev Devices.742gitlab # [ 6.451025] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs743gitlab # [ 6.491948] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.744gitlab # [ 6.516444] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.745gitlab # [ 6.542363] (udev-worker)[407]: Network interface NamePolicy= disabled on kernel command line.746gitlab # [ 6.544565] (udev-worker)[475]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.747gitlab # [ 6.548806] (udev-worker)[475]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 6.565924] systemd[1]: Condition check resulted in Virtio network device being skipped.749gitlab # [ 6.567771] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore750gitlab # [ 6.570647] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67751gitlab # [ 6.573839] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore752gitlab # [ 6.575885] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os753gitlab # [ 6.577801] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os754gitlab # [ 6.591284] systemd[1]: Mounting /run/wrappers...755gitlab # [ 6.608425] mousedev: PS/2 mouse device common for all mice756gitlab # [ 6.624312] systemd[1]: Mounted /run/wrappers.757gitlab # [ 6.625190] systemd[1]: Reached target Local File Systems.758gitlab # [ 6.627724] systemd[1]: Listening on Boot Loader Control Service Socket.759gitlab # [ 6.629995] systemd[1]: Starting register-nix-paths.service...760gitlab # [ 6.632256] systemd[1]: Starting Create SUID/SGID Wrappers...761gitlab # [ 6.633385] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.762gitlab # [ 6.636874] systemd[1]: Starting Save Transient machine-id to Disk...763gitlab # [ 6.668108] systemd[1]: Starting Create System Files and Directories...764gitlab # [ 6.684142] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.765gitlab # [ 6.690330] systemd[1]: Finished Save Transient machine-id to Disk.766gitlab # [ 6.708352] systemd[1]: Finished Create System Files and Directories.767gitlab # [ 6.713672] systemd[1]: Starting Rebuild Journal Catalog...768gitlab # [ 6.716654] systemd[1]: Starting Record System Boot/Shutdown in UTMP...769gitlab # [ 6.755101] systemd[1]: Finished Record System Boot/Shutdown in UTMP.770gitlab # [ 6.768867] systemd[1]: Finished Rebuild Journal Catalog.771gitlab # [ 6.771386] systemd[1]: Starting Update is Completed...772gitlab # [ 6.810359] systemd[1]: Finished Update is Completed.773gitlab # [ 6.850364] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.774gitlab # [ 6.852504] systemd[1]: Finished Create SUID/SGID Wrappers.775gitlab # [ 6.854148] systemd[1]: suid-sgid-wrappers.service: Consumed 155ms CPU time over 219ms wall clock time, 6.2M memory peak, 1.9M read from disk.776gitlab # [ 7.136134] systemd[1]: Finished register-nix-paths.service.777gitlab # [ 7.137371] systemd[1]: Reached target System Initialization.778gitlab # [ 7.138669] systemd[1]: Started Discard unused filesystem blocks once a week.779gitlab # [ 7.142979] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3780gitlab # [ 7.142228] systemd[1]: Started logrotate.timer.781gitlab # [ 7.143032] systemd[1]: Started Daily Cleanup of Temporary Directories.782gitlab # [ 7.144092] systemd[1]: Reached target Timer Units.783gitlab # [ 7.144869] systemd[1]: Listening on D-Bus System Message Bus Socket.784gitlab # [ 7.145813] systemd[1]: Listening on Nix Daemon Socket.785gitlab # [ 7.153980] systemd[1]: Starting nixbot CI service socket...786gitlab # [ 7.155005] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.787gitlab # [ 7.162612] systemd[1]: Starting D-Bus System Message Bus...788gitlab # [ 7.163612] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 7.164701] systemd[1]: Reached target Socket Units.790gitlab # [ 7.203973] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...791gitlab # [ 7.206867] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'792gitlab # [ 7.210552] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"793gitlab # [ 7.213643] systemd[1]: Started D-Bus System Message Bus.794gitlab # [ 7.223149] dbus-broker-launch[562]: Ready795gitlab # [ 7.228162] systemd[1]: Reached target Basic System.796gitlab # [ 7.231715] systemd[1]: Started backdoor.service.797gitlab # [ 7.236383] systemd[1]: Starting gitlab-config.service...798gitlab # [ 7.240530] systemd[1]: Starting Import lastlog data into lastlog2 database...799gitlab # [ 7.260506] systemd[1]: Starting Logrotate configuration check...800gitlab # [ 7.268478] systemd[1]: Starting Name Service Cache Daemon (nsncd)...801gitlab # [ 7.272819] systemd[1]: Starting Post-Boot Actions...802gitlab # [ 7.276746] systemd[1]: Started Reset console on configuration changes.803gitlab # connecting to host...804gitlab # [ 7.284612] logrotate[570]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.805gitlab # [ 7.286956] logrotate[570]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf806gitlab # [ 7.290733] logrotate[570]: note: 'monthly' overrides previously specified 'weekly'807gitlab # [ 7.292051] logrotate[570]: Reading state from file: /var/lib/logrotate.status808gitlab # [ 7.293157] logrotate[570]: state file /var/lib/logrotate.status does not exist809gitlab # [ 7.294247] logrotate[570]: Allocating hash table for state file, size 64 entries810gitlab # [ 7.295399] logrotate[570]: Handling 4 logs811gitlab: Guest shell says: b'Spawning backdoor root shell...\n'812gitlab # [ 7.296217] logrotate[570]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed813gitlab # [ 7.298661] logrotate[570]: considering log /var/log/btmp814gitlab: connected to guest root shell815gitlab # [ 7.299413] logrotate[570]: Creating new state816gitlab: (connecting took 7.86 seconds)817gitlab # [ 7.300099] logrotate[570]: Now: 2026-10-10 10:44818gitlab: (finished: waiting for the VM to finish booting, in 7.86 seconds)819gitlab # [ 7.300803] logrotate[570]: Last rotated at 2026-10-10 10:00820gitlab # [ 7.301564] logrotate[570]: log does not need rotating (log has already been rotated)821gitlab # [ 7.302576] logrotate[570]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed822gitlab # [ 7.304774] logrotate[570]: considering log /var/log/wtmp823gitlab # [ 7.305557] logrotate[570]: Creating new state824gitlab # [ 7.306159] logrotate[570]: Now: 2026-10-10 10:44825gitlab # [ 7.306844] logrotate[570]: Last rotated at 2026-10-10 10:00826gitlab # [ 7.307588] logrotate[570]: log does not need rotating (log has already been rotated)827gitlab # [ 7.308715] logrotate[570]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed828gitlab # [ 7.310494] logrotate[570]: switching euid from 0 to 165 and egid from 0 to 165 (pid 570)829gitlab # [ 7.311722] logrotate[570]: considering log /var/gitlab/state/log/*.log830gitlab # [ 7.312684] logrotate[570]: log /var/gitlab/state/log/*.log does not exist -- skipping831gitlab # [ 7.313694] logrotate[570]: Creating new state832gitlab # [ 7.314307] logrotate[570]: switching euid from 165 to 0 and egid from 165 to 0 (pid 570)833gitlab # [ 7.315399] logrotate[570]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed834gitlab # [ 7.317383] logrotate[570]: switching euid from 0 to 60 and egid from 0 to 60 (pid 570)835gitlab # [ 7.318405] logrotate[570]: considering log /var/log/nginx/*.log836gitlab # [ 7.319847] logrotate[570]: log /var/log/nginx/*.log does not exist -- skipping837gitlab # [ 7.321224] logrotate[570]: Creating new state838gitlab # [ 7.322124] logrotate[570]: not running postrotate script, since no logs were rotated839gitlab # [ 7.323200] logrotate[570]: switching euid from 60 to 0 and egid from 60 to 0 (pid 570)840gitlab # [ 7.324852] nsncd[571]: Oct 10 10:44:44.184 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"841gitlab # [ 7.330963] systemd[1]: Starting resolvconf update...842gitlab # [ 7.332406] systemd[1]: Finished Logrotate configuration check.843gitlab # [ 7.333624] systemd[1]: Finished Post-Boot Actions.844gitlab # [ 7.334629] systemd[1]: Started Name Service Cache Daemon (nsncd).845gitlab # [ 7.335659] systemd[1]: Reached target Host and Network Name Lookups.846gitlab # [ 7.336825] systemd[1]: Reached target User and Group Name Lookups.847gitlab # [ 7.337800] systemd[1]: Starting User Login Management...848gitlab # [ 7.341447] systemd[1]: Starting Virtual Console Setup...849gitlab # [ 7.344218] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 7.366553] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.851gitlab # [ 7.367787] systemd[1]: Stopped Virtual Console Setup.852gitlab # [ 7.372247] systemd[1]: Starting Virtual Console Setup...853gitlab # [ 7.410280] systemd[1]: Stopped target Host and Network Name Lookups.854gitlab # [ 7.412666] systemd[1]: Stopping Host and Network Name Lookups...855gitlab # [ 7.414173] systemd[1]: Stopped target User and Group Name Lookups.856gitlab # [ 7.415256] systemd[1]: Stopping User and Group Name Lookups...857gitlab # [ 7.416681] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...858gitlab # [ 7.417791] systemd[1]: nscd.service: Deactivated successfully.859gitlab # [ 7.418796] systemd[1]: Stopped Name Service Cache Daemon (nsncd).860gitlab # [ 7.419963] systemd[1]: nscd.service: Consumed 28ms CPU time over 146ms wall clock time, 7.6M memory peak, 5.8M read from disk.861gitlab # [ 7.424147] systemd-logind[606]: New seat seat0.862gitlab # [ 7.425151] systemd[1]: Starting Name Service Cache Daemon (nsncd)...863gitlab # [ 7.429042] systemd-logind[606]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)864gitlab # [ 7.430403] systemd-logind[606]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)865gitlab # [ 7.431759] systemd-logind[606]: Watching system buttons on /dev/input/event0 (gpio-keys)866gitlab # [ 7.434643] systemd[1]: Started User Login Management.867gitlab # [ 7.435483] systemd[1]: Starting linger-users.service...868gitlab # [ 7.447840] systemd-vconsole-setup[638]: Configuration of first virtual console was skipped, ignoring remaining ones.869gitlab # [ 7.450058] systemd[1]: Finished Virtual Console Setup.870gitlab # [ 7.465799] systemd[1]: linger-users.service: Deactivated successfully.871gitlab # [ 7.467066] systemd[1]: Finished linger-users.service.872gitlab # [ 7.471705] nsncd[665]: Oct 10 10:44:44.337 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"873gitlab # [ 7.474537] systemd[1]: Started Name Service Cache Daemon (nsncd).874gitlab # [ 7.475615] systemd[1]: Finished resolvconf update.875gitlab # [ 7.476502] systemd[1]: Reached target Preparation for Network.876gitlab # [ 7.477504] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 7.478560] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 7.481729] systemd[1]: Starting DHCP Client...879gitlab # [ 7.486287] systemd[1]: Starting Address configuration of eth1...880gitlab # [ 7.492540] systemd[1]: Starting Extra networking commands....881gitlab # [ 7.541151] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done882gitlab # [ 7.549818] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done883gitlab # [ 7.558311] systemd[1]: Finished Address configuration of eth1.884gitlab # [ 7.585444] dhcpcd[701]: dhcpcd-10.3.2 starting885gitlab # [ 7.588812] dhcpcd[750]: dev: loaded udev886gitlab # [ 7.602019] 8021q: 802.1Q VLAN Support v1.8887gitlab # [ 7.602420] 8021q: adding VLAN 0 to HW filter on device eth1888gitlab # [ 7.599948] systemd[1]: Finished Extra networking commands..889gitlab # [ 7.602029] systemd[1]: Reached target Network.890gitlab # [ 7.606826] systemd[1]: Starting gitlab-workhorse.service...891gitlab # [ 7.612418] systemd[1]: Starting Nginx Web Server...892gitlab # [ 7.620231] systemd[1]: Starting PostgreSQL Server...893gitlab # [ 7.624919] systemd[1]: Starting Redis Server - redis-gitlab...894gitlab # [ 7.633507] systemd[1]: Starting Permit User Sessions...895gitlab # [ 7.641495] cfg80211: Loading compiled-in X.509 certificates for regulatory database896gitlab # [ 7.641173] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.897gitlab # [ 7.651656] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'898gitlab # [ 7.652436] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'899gitlab # [ 7.654434] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2900gitlab # [ 7.654774] cfg80211: failed to load regulatory.db901gitlab # [ 7.670859] systemd[1]: Finished Permit User Sessions.902gitlab # [ 7.692718] systemd[1]: Started Getty on tty1.903gitlab # [ 7.697597] systemd[1]: Reached target Login Prompts.904gitlab # [ 7.705116] 8021q: adding VLAN 0 to HW filter on device eth0905gitlab # [ 7.705006] dhcpcd[750]: eth0: waiting for carrier906gitlab # [ 7.706063] dhcpcd[750]: eth0: carrier acquired907gitlab # [ 7.712296] dhcpcd[750]: DUID 00:01:00:01:32:5c:d3:9c:52:54:00:12:34:56908gitlab # [ 7.713555] dhcpcd[750]: eth0: IAID 00:12:34:56909gitlab # [ 7.714250] dhcpcd[750]: eth0: adding address fe80::5054:ff:fe12:3456910gitlab # [ 7.809350] nginx-pre-start[796]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok911gitlab # [ 7.811132] nginx-pre-start[796]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful912gitlab # [ 7.816787] systemd[1]: Started Nginx Web Server.913gitlab # [ 7.821476] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".914gitlab # [ 7.823112] postgresql-pre-start[795]: This user must also own the server process.915gitlab # [ 7.826984] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".916gitlab # [ 7.828683] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".917gitlab # [ 7.830126] postgresql-pre-start[795]: The default text search configuration will be set to "english".918gitlab # [ 7.831547] postgresql-pre-start[795]: Data page checksums are enabled.919gitlab # [ 7.832946] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok920gitlab # [ 7.834386] postgresql-pre-start[795]: creating subdirectories ... ok921gitlab # [ 7.835295] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix922gitlab # [ 7.837364] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.923gitlab # [ 7.839630] systemd[1]: Started Redis Server - redis-gitlab.924gitlab # [ 7.840693] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo925gitlab # [ 7.842221] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started926gitlab # [ 7.843950] redis-server[792]: Configuration loaded927gitlab # [ 7.845060] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us928gitlab # [ 7.846198] redis[792]: Running mode=standalone, port=0.929gitlab # [ 7.847241] redis[792]: Server initialized930gitlab # [ 7.848235] redis[792]: Ready to accept connections unix931gitlab # [ 7.849505] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.932gitlab # [ 7.881514] postgresql-pre-start[795]: selecting default "max_connections" ... 100933gitlab # [ 7.936257] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB934gitlab # [ 8.272218] systemd[1]: Started gitlab-workhorse.service.935gitlab # [ 8.465200] postgresql-pre-start[795]: selecting default time zone ... UTC936gitlab # [ 8.467751] postgresql-pre-start[795]: creating configuration files ... ok937gitlab # [ 8.567302] gitlab-workhorse[819]: time="2026-10-10T10:44:45Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 8.571412] gitlab-workhorse[819]: time="2026-10-10T10:44:45Z" level=info msg="Using redis/go-redis"939gitlab # [ 8.573364] gitlab-workhorse[819]: time="2026-10-10T10:44:45Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 8.717651] postgresql-pre-start[795]: running bootstrap script ... ok941gitlab # [ 9.114412] dhcpcd[750]: eth0: soliciting a DHCP lease942gitlab # [ 9.128902] dhcpcd[750]: eth0: offered 10.0.2.15 from 10.0.2.2943gitlab # [ 9.148468] dhcpcd[750]: eth0: probing address 10.0.2.15/24944gitlab # [ 9.451084] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok945gitlab # [ 9.568139] dhcpcd[750]: eth0: soliciting an IPv6 router946gitlab # [ 9.569848] dhcpcd[750]: eth0: Router Advertisement from fe80::2947gitlab # [ 9.571318] dhcpcd[750]: eth0: adding address fec0::5054:ff:fe12:3456/64948gitlab # [ 9.573340] dhcpcd[750]: eth0: adding route to fec0::/64949gitlab # [ 9.574536] dhcpcd[750]: eth0: adding default route via fe80::2950gitlab # [ 9.668430] postgresql-pre-start[795]: syncing data to disk ... ok951gitlab # [ 9.669806] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections952gitlab # [ 9.671605] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.953gitlab # [ 9.674709] postgresql-pre-start[795]: Success. You can now start the database server using:954gitlab # [ 9.676353] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start955gitlab # [ 9.827585] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit956gitlab # [ 9.830882] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432957gitlab # [ 9.832935] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432958gitlab # [ 9.834958] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"959gitlab # [ 9.843302] postgres[862]: [862] LOG: database system was shut down at 2026-10-10 10:44:46 GMT960gitlab # [ 9.854546] postgres[852]: [852] LOG: database system is ready to accept connections961gitlab # [ 9.859846] systemd[1]: Started PostgreSQL Server.962gitlab # [ 9.863579] systemd[1]: Starting PostgreSQL Setup Scripts...963gitlab # [ 10.094679] postgresql-setup-start[878]: CREATE DATABASE964gitlab # [ 10.105280] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[871]: mkdir -p /var/gitlab/state/home/.ssh: OK965gitlab # [ 10.107596] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[871]: chmod 700 /var/gitlab/state/home/.ssh: OK966gitlab # [ 10.129463] postgresql-setup-start[887]: CREATE ROLE967gitlab # [ 10.144078] postgresql-setup-start[891]: ALTER DATABASE968gitlab # [ 10.169324] systemd[1]: Finished gitlab-config.service.969gitlab # [ 10.173653] systemd[1]: Started gitaly.service.970gitlab # [ 10.182531] postgresql-setup-start[901]: CREATE ROLE971gitlab # [ 10.200768] systemd[1]: Finished PostgreSQL Setup Scripts.972gitlab # [ 10.202846] systemd[1]: Reached target PostgreSQL.973gitlab # [ 10.206520] systemd[1]: Starting gitlab-db-config.service...974gitlab # [ 10.209930] systemd[1]: Starting gitlab-postgresql.service...975gitlab # [ 10.342288] gitlab-postgresql-start[914]: CREATE DATABASE976gitlab # [ 10.403744] gitlab-postgresql-start[919]: CREATE EXTENSION977gitlab # [ 10.516961] gitlab-postgresql-start[921]: CREATE EXTENSION978gitlab # [ 10.523346] systemd[1]: Finished gitlab-postgresql.service.979gitlab # [ 10.914581] gitaly[903]: time="2026-10-10T10:44:47.780Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=903980gitlab # [ 10.928340] gitaly[903]: time="2026-10-10T10:44:47.781Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=903981gitlab # [ 10.931079] gitaly[903]: time="2026-10-10T10:44:47.781Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=903982gitlab # [ 10.934653] gitaly[903]: time="2026-10-10T10:44:47.781Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=903983gitlab # [ 10.937693] gitaly[903]: time="2026-10-10T10:44:47.781Z" level=info msg="Starting Gitaly" pid=903 version=984gitlab # [ 11.141079] gitaly[903]: time="2026-10-10T10:44:48.007Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=225 pid=903985gitlab # [ 11.143588] gitaly[903]: time="2026-10-10T10:44:48.008Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=903986gitlab # [ 11.145643] gitaly[903]: time="2026-10-10T10:44:48.008Z" level=info msg="finished initializing command factory" duration_ms=0 pid=903987gitlab # [ 11.147598] gitaly[903]: time="2026-10-10T10:44:48.008Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-903/git-exec-2885496690.d/git pid=903988gitlab # [ 11.150226] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="finished detecting git version" duration_ms=7 pid=903989gitlab # [ 11.152149] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="using Git version" pid=903 version=2.53.g990gitlab # [ 11.154331] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="clearing disk cache object folder" pid=903 storage=default991gitlab # [ 11.156435] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache970404879 pid=903 storage=default992gitlab # [ 11.159729] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache970404879 pid=903 storage=default993gitlab # [ 11.163597] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=903994gitlab # [ 11.167819] gitaly[903]: time="2026-10-10T10:44:48.016Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=903995gitlab # [ 11.171589] gitaly[903]: time="2026-10-10T10:44:48.017Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache970404879 clear_duration_ms=0 pid=903 storage=default996gitlab # [ 11.175272] gitaly[903]: time="2026-10-10T10:44:48.033Z" level=info msg="counting repositories" pid=903997gitlab # [ 11.177010] gitaly[903]: time="2026-10-10T10:44:48.033Z" level=info msg="starting to count repositories" pid=903 storage_path=/var/gitlab/state/repositories998gitlab # [ 11.179247] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=903 storage_path=/var/gitlab/state/repositories999gitlab # [ 11.182076] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9031000gitlab # [ 11.184106] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=info msg="finished tempdir cleaner walk" pid=903 storage=default time_ms=01001gitlab # [ 11.186013] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9031002gitlab # [ 11.188403] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=903 schema=unix1003gitlab # [ 11.190492] gitaly[903]: time="2026-10-10T10:44:48.034Z" level=info msg="listening at address" address=/run/gitaly/gitaly-903/sock.d/intern pid=903 schema=unix1004gitlab # [ 11.192644] gitaly[903]: time="2026-10-10T10:44:48.036Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9031005gitlab # [ 11.194637] gitaly[903]: time="2026-10-10T10:44:48.036Z" level=info msg="Started Gitaly" duration_ms=255 pid=9031006gitlab # [ 11.196359] gitaly[903]: time="2026-10-10T10:44:48.037Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9031007gitlab # [ 11.198383] gitaly[903]: time="2026-10-10T10:44:48.037Z" level=info msg="maintenance: daily scheduled" pid=903 scheduled="2026-10-10 12:00:00 +0000 UTC"1008gitlab # [ 11.639542] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[909]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1009gitlab # [ 11.644876] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[909]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1010gitlab # [ 11.658294] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[909]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1011gitlab # [ 14.340791] dhcpcd[750]: eth0: leased 10.0.2.15 for 86400 seconds1012gitlab # [ 14.341010] dhcpcd[750]: eth0: adding route to 10.0.2.0/241013gitlab # [ 14.341084] dhcpcd[750]: eth0: adding default route via 10.0.2.21014gitlab # [ 14.470506] systemd[1]: Started DHCP Client.1015gitlab # [ 14.473422] systemd[1]: Reached target Network is Online.1016gitlab # [ 15.211660] gitaly[903]: time="2026-10-10T10:44:52.077Z" level=info msg="License database preloaded" duration_ms=4296 pid=9031017gitlab # [ 68.640344] gitlab-workhorse[819]: time="2026-10-10T10:45:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1018gitlab # [ 69.840814] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[909]: W, [2026-10-10T10:45:46.706821 #909] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1019gitlab # [ 73.759769] postgres[1563]: [1563] ERROR: relation "feature_gates" does not exist at character 5231020gitlab # [ 73.760153] postgres[1563]: [1563] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1021gitlab # [ 73.760236] postgres[1563]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1022gitlab # [ 73.760305] postgres[1563]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1023gitlab # [ 73.760367] postgres[1563]: attidentity AS identity,1024gitlab # [ 73.760427] postgres[1563]: attgenerated as attgenerated1025gitlab # [ 73.760509] postgres[1563]: FROM pg_attribute a1026gitlab # [ 73.760573] postgres[1563]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1027gitlab # [ 73.760636] postgres[1563]: LEFT JOIN pg_type t ON a.atttypid = t.oid1028gitlab # [ 73.760697] postgres[1563]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1029gitlab # [ 73.760757] postgres[1563]: WHERE a.attrelid = '"feature_gates"'::regclass1030gitlab # [ 73.760816] postgres[1563]: AND a.attnum > 0 AND NOT a.attisdropped1031gitlab # [ 73.760877] postgres[1563]: ORDER BY a.attnum1032gitlab # [ 73.760956] postgres[1563]:1033gitlab # [ 78.643114] gitlab-workhorse[819]: time="2026-10-10T10:45:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 79.800497] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1623]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1035gitlab # [ 79.800813] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1623]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1036gitlab # [ 88.653230] gitlab-workhorse[819]: time="2026-10-10T10:46:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 98.662026] gitlab-workhorse[819]: time="2026-10-10T10:46:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 108.671665] gitlab-workhorse[819]: time="2026-10-10T10:46:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 108.926815] postgres[1771]: [1771] ERROR: relation "table_without_models" does not exist1040gitlab # [ 108.928949] postgres[1771]: [1771] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1041gitlab # [ 118.677687] gitlab-workhorse[819]: time="2026-10-10T10:46:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 128.681226] gitlab-workhorse[819]: time="2026-10-10T10:46:45Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 133.778478] systemd[1]: Finished gitlab-db-config.service.1044gitlab # [ 133.782874] systemd[1]: Started gitlab-sidekiq.service.1045gitlab # [ 133.786444] systemd[1]: Starting gitlab.service...1046gitlab # [ 134.455075] bundle[2092]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1047gitlab # [ 134.458700] bundle[2092]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1048gitlab # [ 134.461896] bundle[2092]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1049gitlab # [ 138.682006] gitlab-workhorse[819]: time="2026-10-10T10:46:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1050gitlab # [ 141.788464] sidekiq-cluster[2091]: {"severity":"INFO","time":"2026-10-10T10:46:58.612Z","message":"Starting cluster with 1 processes"}1051gitlab # [ 141.799145] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.620Z","pid":2092,"message":"* Enabling systemd notification integration"}1052gitlab # [ 141.802048] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"Puma starting in cluster mode..."}1053gitlab # [ 141.804615] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 141.807168] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 141.810553] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Min threads: 0"}1056gitlab # [ 141.812760] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Max threads: 4"}1057gitlab # [ 141.814918] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Environment: production"}1058gitlab # [ 141.817289] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Master PID: 2092"}1059gitlab # [ 141.819512] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Workers: 2"}1060gitlab # [ 141.821812] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 141.824643] bundle[2092]: {"timestamp":"2026-10-10T10:46:58.665Z","pid":2092,"message":"* Preloading application"}1062gitlab # [ 148.683051] gitlab-workhorse[819]: time="2026-10-10T10:47:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 158.689434] gitlab-workhorse[819]: time="2026-10-10T10:47:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 168.699511] gitlab-workhorse[819]: time="2026-10-10T10:47:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 178.709227] gitlab-workhorse[819]: time="2026-10-10T10:47:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 188.717426] gitlab-workhorse[819]: time="2026-10-10T10:47:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 190.152664] bundle[2092]: W, [2026-10-10T10:47:47.018760 #2092] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 195.735013] sidekiq-cluster[2168]: 2026-10-10T10:47:52.601Z pid=2168 tid=xqo INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2168, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426512384}1069gitlab # [ 196.070901] sidekiq-cluster[2168]: W, [2026-10-10T10:47:52.937573 #2168] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 196.232904] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:53.099Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 198.725512] gitlab-workhorse[819]: time="2026-10-10T10:47:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1072gitlab # [ 199.837852] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.703Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 199.838125] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.704Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 199.877406] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.744Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 199.881576] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.747Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 199.885631] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.751Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 199.889318] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.754Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 199.893531] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.758Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 199.897310] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.762Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 199.901211] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.765Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 199.904660] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.768Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 199.908171] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.770Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 199.911611] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.773Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 199.915689] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.776Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 199.919547] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.779Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 199.923049] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.782Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 199.926753] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.784Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 199.930359] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.787Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 199.933804] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.790Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 199.936887] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.794Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 199.939729] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.798Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 199.942947] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.801Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 199.945894] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.805Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 199.949066] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.808Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 199.952147] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.811Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 199.954769] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.814Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 199.958455] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.817Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 199.961244] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.820Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 199.964061] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.824Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 199.966952] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.828Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 199.970083] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.831Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 199.972993] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.834Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 199.975937] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.837Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 199.978849] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.840Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 199.982036] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.843Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 199.984804] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.846Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 199.987786] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.849Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 199.990835] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.852Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 199.993685] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.854Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 199.996461] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.856Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 199.998966] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.859Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 200.001536] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.861Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 200.003869] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.863Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 200.006608] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.865Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 200.009065] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.866Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 200.011420] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.868Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 200.013766] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.870Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 200.016056] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.873Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 200.018424] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.875Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 200.020713] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.877Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 200.022917] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.879Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 200.025114] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.882Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 200.027295] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.884Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 200.029575] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.886Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 200.031706] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.889Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 200.036641] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.903Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 200.039747] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.906Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 200.042477] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.909Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 200.045107] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.911Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 200.047541] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.914Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 200.050608] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.917Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 200.052954] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:56.919Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 200.141983] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.008Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 200.145309] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.011Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 200.148595] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.013Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 200.152058] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.017Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 200.155544] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.019Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 200.159306] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.023Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 200.162934] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.026Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 200.167259] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.028Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 200.170888] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.030Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 200.174677] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.033Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 200.178469] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.035Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 200.182170] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.038Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 200.185795] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.040Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 200.189381] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.042Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 200.193147] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.045Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 200.196733] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.047Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 200.200268] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.049Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 200.203399] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.052Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 200.206943] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.054Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 200.209962] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.056Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 200.212747] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.059Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 200.215675] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.061Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 200.218811] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.063Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 200.221649] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.066Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 200.224237] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.069Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 200.226973] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.071Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 200.229603] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.074Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 200.232264] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.077Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 200.234754] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.079Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 200.237313] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.081Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 200.239690] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.083Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 200.242239] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.085Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 200.244554] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.087Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 200.246877] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.090Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 200.249464] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.092Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 200.251659] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.095Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 200.254273] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.098Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 200.256757] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.101Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 200.259157] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.105Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 200.261665] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.115Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 200.264099] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.117Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 200.266430] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.119Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 200.268951] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.123Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 200.271265] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.127Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 200.273631] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.129Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 200.276109] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.133Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 200.278611] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.135Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 200.281275] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.138Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 200.283672] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.143Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 200.286172] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:47:57.147Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 208.736631] gitlab-workhorse[819]: time="2026-10-10T10:48:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 218.735289] gitlab-workhorse[819]: time="2026-10-10T10:48:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 228.741370] gitlab-workhorse[819]: time="2026-10-10T10:48:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 238.751189] gitlab-workhorse[819]: time="2026-10-10T10:48:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 243.271991] postgres[3059]: [3059] ERROR: relation "table_without_models" does not exist1188gitlab # [ 243.272305] postgres[3059]: [3059] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 246.774147] postgres[3096]: [3096] ERROR: relation "table_without_models" does not exist1190gitlab # [ 246.774389] postgres[3096]: [3096] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 248.359909] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:45.226Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 248.366630] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:45.233Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 248.369349] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:45.235Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 248.371600] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:45.235Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 248.374327] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:45.238Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 248.755316] gitlab-workhorse[819]: time="2026-10-10T10:48:45Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197gitlab # [ 251.243825] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:48.109Z","message":"Cleaning working queues"}1198gitlab # [ 251.245175] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:48.111Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5584e6b0bc3b3bfcddb9e614","created_at":"2026-10-10T10:46:49.980Z","trace_propagation_headers":{"sentry-trace":"407ac9983625451593878f810855880e-499def4a8c3d4ab8","baggage":"sentry-trace_id=407ac9983625451593878f810855880e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"bacc25d0f7b2542baab0801f21bbae75","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-10T10:46:49.995Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5584e6b0bc3b3bfcddb9e614: start","job_status":"start","queue_duration_s":118.116401,"scheduling_latency_s":118.116462}1199gitlab # [ 251.512510] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:48:48.378Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5584e6b0bc3b3bfcddb9e614","created_at":"2026-10-10T10:46:49.980Z","trace_propagation_headers":{"sentry-trace":"407ac9983625451593878f810855880e-499def4a8c3d4ab8","baggage":"sentry-trace_id=407ac9983625451593878f810855880e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"bacc25d0f7b2542baab0801f21bbae75","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-10T10:46:49.995Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5584e6b0bc3b3bfcddb9e614: done: 0.267134 sec","job_status":"done","queue_duration_s":118.116401,"scheduling_latency_s":118.116462,"redis_calls":29,"redis_duration_s":0.008458,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005051,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002062,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.153288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14914101999999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.267134,"completed_at":"2026-10-10T10:48:48.378Z","load_balancing_strategy":"primary","db_duration_s":0.067419,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1200gitlab # [ 253.907179] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.773Z","pid":2092,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 253.907450] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.773Z","pid":2092,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 253.907567] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.773Z","pid":2092,"message":"! #\u003cThread:0x0000edcbc1e5f508 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 253.907638] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.773Z","pid":2092,"message":"! #\u003cThread:0x0000edcbc171eff0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 253.907701] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.773Z","pid":2092,"message":"Use Ctrl-C to stop"}1205gitlab # [ 253.907760] bundle[2092]: {"timestamp":"2026-10-10T10:48:50.774Z","pid":2092,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 254.614689] bundle[2092]: {"timestamp":"2026-10-10T10:48:51.481Z","pid":2092,"message":"- Worker 0 (PID: 3198) booted in 0.67s, phase: 0"}1207gitlab # [ 254.655416] bundle[2092]: {"timestamp":"2026-10-10T10:48:51.522Z","pid":2092,"message":"- Worker 1 (PID: 3202) booted in 0.68s, phase: 0"}1208gitlab # [ 254.659979] systemd[1]: Started gitlab.service.1209gitlab # [ 254.660990] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 254.663847] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 254.696374] setup-gitlab-start[3235]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 258.471634] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:48:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 37401213gitlab # [ 258.475576] setup-gitlab-start[3235]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 258.477367] setup-gitlab-start[3235]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 258.487301] runuser[3261]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 259.206061] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 259.206417] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 259.213616] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 260.504564] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 260.504872] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 260.507904] setup-gitlab-start[3262]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 263.355707] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:00.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"793663c000bdc603733dfbda","created_at":"2026-10-10T10:49:00.137Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b1cab0a824f5a23bbec2908adeb4f14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.218Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-793663c000bdc603733dfbda: start","job_status":"start","queue_duration_s":0.002353,"scheduling_latency_s":0.002403}1223gitlab # [ 264.007135] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:00.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"793663c000bdc603733dfbda","created_at":"2026-10-10T10:49:00.137Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b1cab0a824f5a23bbec2908adeb4f14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.218Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-793663c000bdc603733dfbda: done: 0.650746 sec","job_status":"done","queue_duration_s":0.002353,"scheduling_latency_s":0.002403,"redis_calls":14,"redis_duration_s":0.038553000000000004,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008019,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.021843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00226166,"exclusive_lock_hold_duration_s":0.35539372,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.650746,"completed_at":"2026-10-10T10:49:00.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 264.081330] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:00.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a3b14be1ee58358a54efc2cd","created_at":"2026-10-10T10:49:00.291Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b4985b8160ba8cfcbf7b86bdcfe4976","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.319Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a3b14be1ee58358a54efc2cd: start","job_status":"start","queue_duration_s":0.569308,"scheduling_latency_s":0.56939}1225gitlab # [ 264.144530] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a3b14be1ee58358a54efc2cd","created_at":"2026-10-10T10:49:00.291Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b4985b8160ba8cfcbf7b86bdcfe4976","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.319Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a3b14be1ee58358a54efc2cd: done: 0.12167 sec","job_status":"done","queue_duration_s":0.569308,"scheduling_latency_s":0.56939,"redis_calls":12,"redis_duration_s":0.015557999999999999,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00107,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002329,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00456036,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.12167,"completed_at":"2026-10-10T10:49:01.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 264.229737] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ae74e8b8bd675b847531c18b","created_at":"2026-10-10T10:49:00.346Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2040797a72a3062df995ab997069ef3a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.369Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ae74e8b8bd675b847531c18b: start","job_status":"start","queue_duration_s":0.711389,"scheduling_latency_s":0.711446}1227gitlab # [ 264.416304] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ae74e8b8bd675b847531c18b","created_at":"2026-10-10T10:49:00.346Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2040797a72a3062df995ab997069ef3a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.369Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ae74e8b8bd675b847531c18b: done: 0.199386 sec","job_status":"done","queue_duration_s":0.711389,"scheduling_latency_s":0.711446,"redis_calls":12,"redis_duration_s":0.021532,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0021701,"exclusive_lock_hold_duration_s":0.038278639999999996,"duration_s":0.199386,"completed_at":"2026-10-10T10:49:01.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 264.480761] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1777502f07bbafdd80c3fa36","created_at":"2026-10-10T10:49:00.388Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51d1e42fa4f17301d771a0dabe939af0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.426Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1777502f07bbafdd80c3fa36: start","job_status":"start","queue_duration_s":0.85875,"scheduling_latency_s":0.858812}1229gitlab # [ 264.714014] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1777502f07bbafdd80c3fa36","created_at":"2026-10-10T10:49:00.388Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51d1e42fa4f17301d771a0dabe939af0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.426Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1777502f07bbafdd80c3fa36: done: 0.29424 sec","job_status":"done","queue_duration_s":0.85875,"scheduling_latency_s":0.858812,"redis_calls":12,"redis_duration_s":0.029276,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010595,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006955,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00695026,"duration_s":0.29424,"completed_at":"2026-10-10T10:49:01.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 264.783934] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"49783af9d5a3ea4d2c678a45","created_at":"2026-10-10T10:49:00.463Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.517Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-49783af9d5a3ea4d2c678a45: start","job_status":"start","queue_duration_s":1.07726,"scheduling_latency_s":1.077332}1231gitlab # [ 265.021115] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"49783af9d5a3ea4d2c678a45","created_at":"2026-10-10T10:49:00.463Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.517Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-49783af9d5a3ea4d2c678a45: done: 0.291708 sec","job_status":"done","queue_duration_s":1.07726,"scheduling_latency_s":1.077332,"redis_calls":19,"redis_duration_s":0.066537,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007865,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.002815,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.051917,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00237718,"duration_s":0.291708,"completed_at":"2026-10-10T10:49:01.886Z","load_balancing_strategy":"primary","db_duration_s":0.029463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 265.093118] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4583f282b8385703015fb5be","created_at":"2026-10-10T10:49:00.542Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48abb4e89c0a15604f6ef36e4bfb994b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:49:00.563Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4583f282b8385703015fb5be: start","job_status":"start","queue_duration_s":1.332338,"scheduling_latency_s":1.332386}1233gitlab # [ 265.111780] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.939Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1234gitlab # [ 265.118033] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4583f282b8385703015fb5be","created_at":"2026-10-10T10:49:00.542Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48abb4e89c0a15604f6ef36e4bfb994b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:49:00.563Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4583f282b8385703015fb5be: done: 0.060257 sec","job_status":"done","queue_duration_s":1.332338,"scheduling_latency_s":1.332386,"redis_calls":10,"redis_duration_s":0.002992,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000672,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041018,"duration_s":0.060257,"completed_at":"2026-10-10T10:49:01.956Z","load_balancing_strategy":"primary","db_duration_s":0.000889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 265.170836] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:01.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"90d44f895c354afdd1d44e49","created_at":"2026-10-10T10:49:00.589Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.601Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-90d44f895c354afdd1d44e49: start","job_status":"start","queue_duration_s":1.358,"scheduling_latency_s":1.358036}1236gitlab # [ 265.295143] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"90d44f895c354afdd1d44e49","created_at":"2026-10-10T10:49:00.589Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.601Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-90d44f895c354afdd1d44e49: done: 0.201721 sec","job_status":"done","queue_duration_s":1.358,"scheduling_latency_s":1.358036,"redis_calls":65,"redis_duration_s":0.019915,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001009,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.001446,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016453,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.17929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005913,"duration_s":0.201721,"completed_at":"2026-10-10T10:49:02.160Z","load_balancing_strategy":"primary","db_duration_s":0.001164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 265.368249] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fdf375adfd81e3d28a72482d","created_at":"2026-10-10T10:49:00.615Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.624Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fdf375adfd81e3d28a72482d: start","job_status":"start","queue_duration_s":1.539629,"scheduling_latency_s":1.539662}1238gitlab # [ 265.497687] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fdf375adfd81e3d28a72482d","created_at":"2026-10-10T10:49:00.615Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.624Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fdf375adfd81e3d28a72482d: done: 0.198801 sec","job_status":"done","queue_duration_s":1.539629,"scheduling_latency_s":1.539662,"redis_calls":71,"redis_duration_s":0.019644,"redis_read_bytes":121,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003189,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000708,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014735,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046384,"duration_s":0.198801,"completed_at":"2026-10-10T10:49:02.362Z","load_balancing_strategy":"primary","db_duration_s":0.003941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 265.568402] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.365Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"602fd57af90004ed69d0ea40","created_at":"2026-10-10T10:49:00.629Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"13344bc8d5922ccfdc781108a394f897","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.644Z","job_size_bytes":3,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-602fd57af90004ed69d0ea40: start","job_status":"start","queue_duration_s":1.721393,"scheduling_latency_s":1.721428}1240gitlab # [ 265.586494] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.401Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"602fd57af90004ed69d0ea40","created_at":"2026-10-10T10:49:00.629Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"13344bc8d5922ccfdc781108a394f897","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.644Z","job_size_bytes":3,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-602fd57af90004ed69d0ea40: done: 0.035757 sec","job_status":"done","queue_duration_s":1.721393,"scheduling_latency_s":1.721428,"redis_calls":10,"redis_duration_s":0.002715,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029226,"duration_s":0.035757,"completed_at":"2026-10-10T10:49:02.401Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 265.638381] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"55fcfd881c1fc631edd60959","created_at":"2026-10-10T10:49:00.658Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc2e5d12f3711801067dd8b0a488475c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.684Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-55fcfd881c1fc631edd60959: start","job_status":"start","queue_duration_s":1.719256,"scheduling_latency_s":1.719283}1242gitlab # [ 265.655470] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.422Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1243gitlab # [ 265.659534] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.433Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"55fcfd881c1fc631edd60959","created_at":"2026-10-10T10:49:00.658Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc2e5d12f3711801067dd8b0a488475c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.684Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-55fcfd881c1fc631edd60959: done: 0.029514 sec","job_status":"done","queue_duration_s":1.719256,"scheduling_latency_s":1.719283,"redis_calls":10,"redis_duration_s":0.002424,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052528,"duration_s":0.029514,"completed_at":"2026-10-10T10:49:02.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 265.706028] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7069f2de2edb90fb0266ff01","created_at":"2026-10-10T10:49:00.713Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96b94988bc1d3f52de0210b595212b06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.734Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7069f2de2edb90fb0266ff01: start","job_status":"start","queue_duration_s":1.700475,"scheduling_latency_s":1.700499}1245gitlab # [ 265.722607] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7069f2de2edb90fb0266ff01","created_at":"2026-10-10T10:49:00.713Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96b94988bc1d3f52de0210b595212b06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.734Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7069f2de2edb90fb0266ff01: done: 0.027144 sec","job_status":"done","queue_duration_s":1.700475,"scheduling_latency_s":1.700499,"redis_calls":10,"redis_duration_s":0.00163,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031386,"duration_s":0.027144,"completed_at":"2026-10-10T10:49:02.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 265.768192] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ad8d7b1ccb6517695cb56a90","created_at":"2026-10-10T10:49:00.785Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f98740f4e402a22d24ed858bed800701","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.820Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ad8d7b1ccb6517695cb56a90: start","job_status":"start","queue_duration_s":1.644041,"scheduling_latency_s":1.644065}1247gitlab # [ 265.783517] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.480Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1248gitlab # [ 265.787529] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ad8d7b1ccb6517695cb56a90","created_at":"2026-10-10T10:49:00.785Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f98740f4e402a22d24ed858bed800701","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.820Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ad8d7b1ccb6517695cb56a90: done: 0.027167 sec","job_status":"done","queue_duration_s":1.644041,"scheduling_latency_s":1.644065,"redis_calls":10,"redis_duration_s":0.002289,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000367,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046714,"duration_s":0.027167,"completed_at":"2026-10-10T10:49:02.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 265.833193] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0cc14d0b80675da79e2f4af8","created_at":"2026-10-10T10:49:00.866Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62f8ec0f1073da4da0d4c6b31e4e6d3d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.963Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0cc14d0b80675da79e2f4af8: start","job_status":"start","queue_duration_s":1.530002,"scheduling_latency_s":1.530025}1250gitlab # [ 265.848486] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.528Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0cc14d0b80675da79e2f4af8","created_at":"2026-10-10T10:49:00.866Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62f8ec0f1073da4da0d4c6b31e4e6d3d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:00.963Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0cc14d0b80675da79e2f4af8: done: 0.034313 sec","job_status":"done","queue_duration_s":1.530002,"scheduling_latency_s":1.530025,"redis_calls":12,"redis_duration_s":0.0024029999999999998,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073234,"exclusive_lock_hold_duration_s":0.0051821,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.034313,"completed_at":"2026-10-10T10:49:02.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 265.894697] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d667ccaa1583efb3a0e81f0","created_at":"2026-10-10T10:49:01.000Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f65f4a1d28a006163d3c4d9cef4a2c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.085Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d667ccaa1583efb3a0e81f0: start","job_status":"start","queue_duration_s":1.444222,"scheduling_latency_s":1.444246}1252gitlab # [ 265.909915] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d667ccaa1583efb3a0e81f0","created_at":"2026-10-10T10:49:01.000Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f65f4a1d28a006163d3c4d9cef4a2c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.085Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d667ccaa1583efb3a0e81f0: done: 0.034934 sec","job_status":"done","queue_duration_s":1.444222,"scheduling_latency_s":1.444246,"redis_calls":10,"redis_duration_s":0.00206,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034642,"duration_s":0.034934,"completed_at":"2026-10-10T10:49:02.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003864,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 265.956471] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:02.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c92157d63ff8e3d7541066a2","created_at":"2026-10-10T10:49:01.115Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebcec0ecec56fa02ec8385a7d5b83b05","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.134Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c92157d63ff8e3d7541066a2: start","job_status":"start","queue_duration_s":1.431682,"scheduling_latency_s":1.431702}1254gitlab # [ 266.403598] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c92157d63ff8e3d7541066a2","created_at":"2026-10-10T10:49:01.115Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebcec0ecec56fa02ec8385a7d5b83b05","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.134Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c92157d63ff8e3d7541066a2: done: 0.702884 sec","job_status":"done","queue_duration_s":1.431682,"scheduling_latency_s":1.431702,"redis_calls":565,"redis_duration_s":0.120082,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.118084,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.641847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063658,"duration_s":0.702884,"completed_at":"2026-10-10T10:49:03.269Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 266.473369] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4817bd3ae555a09b3c9ee7c9","created_at":"2026-10-10T10:49:01.162Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33333e77d193a810e86615124d2d01cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:49:01.184Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4817bd3ae555a09b3c9ee7c9: start","job_status":"start","queue_duration_s":2.088438,"scheduling_latency_s":2.088498}1256gitlab # [ 266.491893] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4817bd3ae555a09b3c9ee7c9","created_at":"2026-10-10T10:49:01.162Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33333e77d193a810e86615124d2d01cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:49:01.184Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4817bd3ae555a09b3c9ee7c9: done: 0.066457 sec","job_status":"done","queue_duration_s":2.088438,"scheduling_latency_s":2.088498,"redis_calls":10,"redis_duration_s":0.003354,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004474,"duration_s":0.066457,"completed_at":"2026-10-10T10:49:03.338Z","load_balancing_strategy":"primary","db_duration_s":0.00677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 266.541157] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"062c42a1fb8e4251501d6c83","created_at":"2026-10-10T10:49:01.263Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61324d56543597a521ec7e7e0484f1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.294Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-062c42a1fb8e4251501d6c83: start","job_status":"start","queue_duration_s":2.046493,"scheduling_latency_s":2.046556}1258gitlab # [ 266.558687] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.364Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1259gitlab # [ 266.563000] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"062c42a1fb8e4251501d6c83","created_at":"2026-10-10T10:49:01.263Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61324d56543597a521ec7e7e0484f1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.294Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-062c42a1fb8e4251501d6c83: done: 0.038103 sec","job_status":"done","queue_duration_s":2.046493,"scheduling_latency_s":2.046556,"redis_calls":10,"redis_duration_s":0.003013,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061968,"duration_s":0.038103,"completed_at":"2026-10-10T10:49:03.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 266.611576] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"856db34b64b85bdaeab2063e","created_at":"2026-10-10T10:49:01.308Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc9999eeb11541c767e2a8d5d3c15e77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.328Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-856db34b64b85bdaeab2063e: start","job_status":"start","queue_duration_s":2.053642,"scheduling_latency_s":2.053667}1261gitlab # [ 266.691704] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.558Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1262gitlab # [ 266.705051] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"856db34b64b85bdaeab2063e","created_at":"2026-10-10T10:49:01.308Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc9999eeb11541c767e2a8d5d3c15e77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.328Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-856db34b64b85bdaeab2063e: done: 0.188873 sec","job_status":"done","queue_duration_s":2.053642,"scheduling_latency_s":2.053667,"redis_calls":10,"redis_duration_s":0.002353,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034982,"duration_s":0.188873,"completed_at":"2026-10-10T10:49:03.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 266.775662] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d5d7f8bf6d9a25aeafc42a37","created_at":"2026-10-10T10:49:01.386Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"418e8ac38070fbdda8a83106e061c24a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.416Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d5d7f8bf6d9a25aeafc42a37: start","job_status":"start","queue_duration_s":2.157186,"scheduling_latency_s":2.157215}1264gitlab # [ 266.793151] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.607Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d5d7f8bf6d9a25aeafc42a37","created_at":"2026-10-10T10:49:01.386Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"418e8ac38070fbdda8a83106e061c24a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.416Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d5d7f8bf6d9a25aeafc42a37: done: 0.033791 sec","job_status":"done","queue_duration_s":2.157186,"scheduling_latency_s":2.157215,"redis_calls":12,"redis_duration_s":0.0034560000000000003,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000751,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001574,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047108,"duration_s":0.033791,"completed_at":"2026-10-10T10:49:03.607Z","load_balancing_strategy":"primary","db_duration_s":0.000763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 266.838778] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0770820195c5f35a7d82720e","created_at":"2026-10-10T10:49:01.461Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"691ed9e2237cdb5081e9f3f27fd694f5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.513Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0770820195c5f35a7d82720e: start","job_status":"start","queue_duration_s":2.096394,"scheduling_latency_s":2.096418}1266gitlab # [ 266.854376] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0770820195c5f35a7d82720e","created_at":"2026-10-10T10:49:01.461Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"691ed9e2237cdb5081e9f3f27fd694f5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.513Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0770820195c5f35a7d82720e: done: 0.065268 sec","job_status":"done","queue_duration_s":2.096394,"scheduling_latency_s":2.096418,"redis_calls":13,"redis_duration_s":0.004327,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000828,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001986,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001513,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02252042,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.065268,"completed_at":"2026-10-10T10:49:03.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004236,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1267gitlab # [ 266.901490] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"391347cca3c69c71f5d0aa3c","created_at":"2026-10-10T10:49:01.575Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3d779a4e753540eab50b227ca7de7c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.604Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-391347cca3c69c71f5d0aa3c: start","job_status":"start","queue_duration_s":2.073035,"scheduling_latency_s":2.073063}1268gitlab # [ 266.916582] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"391347cca3c69c71f5d0aa3c","created_at":"2026-10-10T10:49:01.575Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3d779a4e753540eab50b227ca7de7c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.604Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-391347cca3c69c71f5d0aa3c: done: 0.057014 sec","job_status":"done","queue_duration_s":2.073035,"scheduling_latency_s":2.073063,"redis_calls":16,"redis_duration_s":0.003407,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001553,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041126,"duration_s":0.057014,"completed_at":"2026-10-10T10:49:03.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 266.962519] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e338486b719a2f24acf28a63","created_at":"2026-10-10T10:49:01.615Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff6bfb4ed34ea7d54ea4c5bf0bd307d1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.631Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e338486b719a2f24acf28a63: start","job_status":"start","queue_duration_s":2.105623,"scheduling_latency_s":2.105652}1270gitlab # [ 266.978327] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e338486b719a2f24acf28a63","created_at":"2026-10-10T10:49:01.615Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff6bfb4ed34ea7d54ea4c5bf0bd307d1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.631Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e338486b719a2f24acf28a63: done: 0.058995 sec","job_status":"done","queue_duration_s":2.105623,"scheduling_latency_s":2.105652,"redis_calls":10,"redis_duration_s":0.002925,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000533,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060922,"duration_s":0.058995,"completed_at":"2026-10-10T10:49:03.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 267.025656] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bc021d26b54a947ef30d9b26","created_at":"2026-10-10T10:49:01.641Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26c9c149e19c63693c04eb6b8e49a902","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:49:01.655Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bc021d26b54a947ef30d9b26: start","job_status":"start","queue_duration_s":2.144436,"scheduling_latency_s":2.144469}1272gitlab # [ 267.040796] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.831Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1273gitlab # [ 267.044449] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bc021d26b54a947ef30d9b26","created_at":"2026-10-10T10:49:01.641Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26c9c149e19c63693c04eb6b8e49a902","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:49:01.655Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bc021d26b54a947ef30d9b26: done: 0.061236 sec","job_status":"done","queue_duration_s":2.144436,"scheduling_latency_s":2.144469,"redis_calls":10,"redis_duration_s":0.007327,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000732,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003877,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089934,"duration_s":0.061236,"completed_at":"2026-10-10T10:49:03.860Z","load_balancing_strategy":"primary","db_duration_s":0.000919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 267.089210] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"191372b3014e47d593c8b7a3","created_at":"2026-10-10T10:49:01.662Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"511bf732b6a70e2f6e888cf35e0ce5cc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.678Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-191372b3014e47d593c8b7a3: start","job_status":"start","queue_duration_s":2.185888,"scheduling_latency_s":2.185923}1275gitlab # [ 267.105723] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"191372b3014e47d593c8b7a3","created_at":"2026-10-10T10:49:01.662Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"511bf732b6a70e2f6e888cf35e0ce5cc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.678Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-191372b3014e47d593c8b7a3: done: 0.074831 sec","job_status":"done","queue_duration_s":2.185888,"scheduling_latency_s":2.185923,"redis_calls":10,"redis_duration_s":0.003078,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052474,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.074831,"completed_at":"2026-10-10T10:49:03.938Z","load_balancing_strategy":"primary","db_duration_s":0.018445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 267.155158] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:03.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b8e38374df3bc6cdf0d5fa94","created_at":"2026-10-10T10:49:01.708Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f12ee59e234c97b3bfad400e9a2e8f1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.739Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b8e38374df3bc6cdf0d5fa94: start","job_status":"start","queue_duration_s":2.203055,"scheduling_latency_s":2.203115}1277gitlab # [ 267.172590] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b8e38374df3bc6cdf0d5fa94","created_at":"2026-10-10T10:49:01.708Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f12ee59e234c97b3bfad400e9a2e8f1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.739Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b8e38374df3bc6cdf0d5fa94: done: 0.060437 sec","job_status":"done","queue_duration_s":2.203055,"scheduling_latency_s":2.203115,"redis_calls":12,"redis_duration_s":0.003985,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000495,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00092386,"exclusive_lock_hold_duration_s":0.01736862,"duration_s":0.060437,"completed_at":"2026-10-10T10:49:04.002Z","load_balancing_strategy":"primary","db_duration_s":0.006484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 267.219333] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.005Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d9bf30f4b63c4a3c2610b11b","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d9bf30f4b63c4a3c2610b11b: start","job_status":"start","queue_duration_s":2.178906,"scheduling_latency_s":2.178932}1279gitlab # [ 267.233073] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.043Z","message":"No existing merge request to be cleaned up."}1280gitlab # [ 267.234878] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.069Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d9bf30f4b63c4a3c2610b11b","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d9bf30f4b63c4a3c2610b11b: done: 0.06396 sec","job_status":"done","queue_duration_s":2.178906,"scheduling_latency_s":2.178932,"redis_calls":13,"redis_duration_s":0.004013,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032598,"duration_s":0.06396,"completed_at":"2026-10-10T10:49:04.069Z","load_balancing_strategy":"primary","db_duration_s":0.011311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 267.279568] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.071Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0f451816d3205d4c1c2a3a9","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0f451816d3205d4c1c2a3a9: start","job_status":"start","queue_duration_s":2.245009,"scheduling_latency_s":2.245039}1282gitlab # [ 267.293877] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.098Z","message":"No existing merge request to be cleaned up."}1283gitlab # [ 267.295837] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.121Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0f451816d3205d4c1c2a3a9","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0f451816d3205d4c1c2a3a9: done: 0.05046 sec","job_status":"done","queue_duration_s":2.245009,"scheduling_latency_s":2.245039,"redis_calls":10,"redis_duration_s":0.003486,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002271,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05046,"completed_at":"2026-10-10T10:49:04.121Z","load_balancing_strategy":"primary","db_duration_s":0.003821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 267.338243] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.124Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a0cfafb91819b90370090980","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a0cfafb91819b90370090980: start","job_status":"start","queue_duration_s":2.298462,"scheduling_latency_s":2.298495}1285gitlab # [ 267.352688] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.149Z","message":"No existing merge request to be cleaned up."}1286gitlab # [ 267.354649] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.166Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a0cfafb91819b90370090980","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a0cfafb91819b90370090980: done: 0.042021 sec","job_status":"done","queue_duration_s":2.298462,"scheduling_latency_s":2.298495,"redis_calls":10,"redis_duration_s":0.002912,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042021,"completed_at":"2026-10-10T10:49:04.166Z","load_balancing_strategy":"primary","db_duration_s":0.002589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 267.398746] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7155c336eb7d136665b94891","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7155c336eb7d136665b94891: start","job_status":"start","queue_duration_s":2.343423,"scheduling_latency_s":2.343468}1288gitlab # [ 267.412359] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.195Z","message":"No existing merge request to be cleaned up."}1289gitlab # [ 267.414212] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.214Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7155c336eb7d136665b94891","created_at":"2026-10-10T10:49:01.728Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-a4c17ce4bd504269","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"abb2ff2231ac56c6c10216dde2fe4c9c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.826Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7155c336eb7d136665b94891: done: 0.044337 sec","job_status":"done","queue_duration_s":2.343423,"scheduling_latency_s":2.343468,"redis_calls":10,"redis_duration_s":0.0032849999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044337,"completed_at":"2026-10-10T10:49:04.214Z","load_balancing_strategy":"primary","db_duration_s":0.002912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 267.458948] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"068029f971feff1af7717e92","created_at":"2026-10-10T10:49:01.808Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98d9483275ad59e93b4b97bad88d73ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.836Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-068029f971feff1af7717e92: start","job_status":"start","queue_duration_s":2.382109,"scheduling_latency_s":2.382132}1291gitlab # [ 267.476543] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"068029f971feff1af7717e92","created_at":"2026-10-10T10:49:01.808Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98d9483275ad59e93b4b97bad88d73ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.836Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-068029f971feff1af7717e92: done: 0.071308 sec","job_status":"done","queue_duration_s":2.382109,"scheduling_latency_s":2.382132,"redis_calls":12,"redis_duration_s":0.003889,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001456,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088684,"exclusive_lock_hold_duration_s":0.02376292,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071308,"completed_at":"2026-10-10T10:49:04.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 267.527209] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"44a6964155da9e8127c4cbc5","created_at":"2026-10-10T10:49:01.875Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"930dbac398ce5c0bdd3a253cd34dba28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.898Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-44a6964155da9e8127c4cbc5: start","job_status":"start","queue_duration_s":2.392769,"scheduling_latency_s":2.392793}1293gitlab # [ 267.900649] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"44a6964155da9e8127c4cbc5","created_at":"2026-10-10T10:49:01.875Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"930dbac398ce5c0bdd3a253cd34dba28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:01.898Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-44a6964155da9e8127c4cbc5: done: 0.47454 sec","job_status":"done","queue_duration_s":2.392769,"scheduling_latency_s":2.392793,"redis_calls":12,"redis_duration_s":0.003278,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.056,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.401972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089224,"exclusive_lock_hold_duration_s":0.44216656,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.47454,"completed_at":"2026-10-10T10:49:04.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 267.975484] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a184a47e393f486dc002d6a","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a184a47e393f486dc002d6a: start","job_status":"start","queue_duration_s":2.625047,"scheduling_latency_s":2.625073}1295gitlab # [ 267.993418] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a184a47e393f486dc002d6a","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a184a47e393f486dc002d6a: done: 0.047536 sec","job_status":"done","queue_duration_s":2.625047,"scheduling_latency_s":2.625073,"redis_calls":13,"redis_duration_s":0.003385,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032126,"duration_s":0.047536,"completed_at":"2026-10-10T10:49:04.815Z","load_balancing_strategy":"primary","db_duration_s":0.008798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 268.043830] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00a70f68bdc071a599355535","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00a70f68bdc071a599355535: start","job_status":"start","queue_duration_s":2.675802,"scheduling_latency_s":2.675893}1297gitlab # [ 268.057261] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"00a70f68bdc071a599355535","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-00a70f68bdc071a599355535: done: 0.05331 sec","job_status":"done","queue_duration_s":2.675802,"scheduling_latency_s":2.675893,"redis_calls":10,"redis_duration_s":0.0038050000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002366,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05331,"completed_at":"2026-10-10T10:49:04.872Z","load_balancing_strategy":"primary","db_duration_s":0.004588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 268.100405] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8dde314581a625eb553de2bf","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8dde314581a625eb553de2bf: start","job_status":"start","queue_duration_s":2.731774,"scheduling_latency_s":2.731797}1299gitlab # [ 268.114639] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8dde314581a625eb553de2bf","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8dde314581a625eb553de2bf: done: 0.030244 sec","job_status":"done","queue_duration_s":2.731774,"scheduling_latency_s":2.731797,"redis_calls":10,"redis_duration_s":0.002339,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030244,"completed_at":"2026-10-10T10:49:04.905Z","load_balancing_strategy":"primary","db_duration_s":0.002382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 268.159913] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0167b4c5188e1363b742b4e8","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0167b4c5188e1363b742b4e8: start","job_status":"start","queue_duration_s":2.764069,"scheduling_latency_s":2.764092}1301gitlab # [ 268.174391] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0167b4c5188e1363b742b4e8","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0167b4c5188e1363b742b4e8: done: 0.026685 sec","job_status":"done","queue_duration_s":2.764069,"scheduling_latency_s":2.764092,"redis_calls":10,"redis_duration_s":0.002504,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026685,"completed_at":"2026-10-10T10:49:04.933Z","load_balancing_strategy":"primary","db_duration_s":0.002441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 268.217686] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a28d7f91e419839ea0903e72","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a28d7f91e419839ea0903e72: start","job_status":"start","queue_duration_s":2.792546,"scheduling_latency_s":2.792569}1303gitlab # [ 268.230920] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a28d7f91e419839ea0903e72","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a28d7f91e419839ea0903e72: done: 0.030271 sec","job_status":"done","queue_duration_s":2.792546,"scheduling_latency_s":2.792569,"redis_calls":10,"redis_duration_s":0.0026309999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030271,"completed_at":"2026-10-10T10:49:04.965Z","load_balancing_strategy":"primary","db_duration_s":0.002486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 268.272696] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:04.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"54dd88271fafa935720a2a58","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-54dd88271fafa935720a2a58: start","job_status":"start","queue_duration_s":2.825459,"scheduling_latency_s":2.825506}1305gitlab # [ 268.285722] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"54dd88271fafa935720a2a58","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-54dd88271fafa935720a2a58: done: 0.05041 sec","job_status":"done","queue_duration_s":2.825459,"scheduling_latency_s":2.825506,"redis_calls":10,"redis_duration_s":0.0036409999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002168,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05041,"completed_at":"2026-10-10T10:49:05.018Z","load_balancing_strategy":"primary","db_duration_s":0.003698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 268.326905] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8b57cc075be93978694a9f8c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8b57cc075be93978694a9f8c: start","job_status":"start","queue_duration_s":2.880234,"scheduling_latency_s":2.880284}1307gitlab # [ 268.340120] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8b57cc075be93978694a9f8c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8b57cc075be93978694a9f8c: done: 0.046811 sec","job_status":"done","queue_duration_s":2.880234,"scheduling_latency_s":2.880284,"redis_calls":10,"redis_duration_s":0.003302,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046811,"completed_at":"2026-10-10T10:49:05.070Z","load_balancing_strategy":"primary","db_duration_s":0.003667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 268.380687] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a26d0eacbd9db896e50a552e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a26d0eacbd9db896e50a552e: start","job_status":"start","queue_duration_s":2.929867,"scheduling_latency_s":2.929914}1309gitlab # [ 268.394904] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a26d0eacbd9db896e50a552e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a26d0eacbd9db896e50a552e: done: 0.036629 sec","job_status":"done","queue_duration_s":2.929867,"scheduling_latency_s":2.929914,"redis_calls":10,"redis_duration_s":0.0028989999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036629,"completed_at":"2026-10-10T10:49:05.109Z","load_balancing_strategy":"primary","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 268.437769] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"97af95f4a185029442acabc4","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-97af95f4a185029442acabc4: start","job_status":"start","queue_duration_s":2.969027,"scheduling_latency_s":2.96908}1311gitlab # [ 268.451965] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"97af95f4a185029442acabc4","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-97af95f4a185029442acabc4: done: 0.047507 sec","job_status":"done","queue_duration_s":2.969027,"scheduling_latency_s":2.96908,"redis_calls":10,"redis_duration_s":0.00329,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047507,"completed_at":"2026-10-10T10:49:05.159Z","load_balancing_strategy":"primary","db_duration_s":0.003484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 268.493806] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be8ecbf85e098b803295ba60","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be8ecbf85e098b803295ba60: start","job_status":"start","queue_duration_s":3.019281,"scheduling_latency_s":3.019307}1313gitlab # [ 268.506925] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be8ecbf85e098b803295ba60","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be8ecbf85e098b803295ba60: done: 0.031756 sec","job_status":"done","queue_duration_s":3.019281,"scheduling_latency_s":3.019307,"redis_calls":10,"redis_duration_s":0.0024869999999999996,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001447,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031756,"completed_at":"2026-10-10T10:49:05.194Z","load_balancing_strategy":"primary","db_duration_s":0.002611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 268.548263] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"15b57677251faa4baae1600b","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-15b57677251faa4baae1600b: start","job_status":"start","queue_duration_s":3.053424,"scheduling_latency_s":3.053447}1315gitlab # [ 268.561364] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"15b57677251faa4baae1600b","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-15b57677251faa4baae1600b: done: 0.025256 sec","job_status":"done","queue_duration_s":3.053424,"scheduling_latency_s":3.053447,"redis_calls":10,"redis_duration_s":0.001988,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025256,"completed_at":"2026-10-10T10:49:05.221Z","load_balancing_strategy":"primary","db_duration_s":0.002508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 268.603877] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b326aff39fe23459d399991f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b326aff39fe23459d399991f: start","job_status":"start","queue_duration_s":3.080146,"scheduling_latency_s":3.080178}1317gitlab # [ 268.617441] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b326aff39fe23459d399991f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b326aff39fe23459d399991f: done: 0.034971 sec","job_status":"done","queue_duration_s":3.080146,"scheduling_latency_s":3.080178,"redis_calls":10,"redis_duration_s":0.0027819999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034971,"completed_at":"2026-10-10T10:49:05.258Z","load_balancing_strategy":"primary","db_duration_s":0.00375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 268.658953] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa0332adda8f14a28e488736","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa0332adda8f14a28e488736: start","job_status":"start","queue_duration_s":3.118799,"scheduling_latency_s":3.118823}1319gitlab # [ 268.672225] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa0332adda8f14a28e488736","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa0332adda8f14a28e488736: done: 0.043905 sec","job_status":"done","queue_duration_s":3.118799,"scheduling_latency_s":3.118823,"redis_calls":10,"redis_duration_s":0.0035050000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002161,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043905,"completed_at":"2026-10-10T10:49:05.305Z","load_balancing_strategy":"primary","db_duration_s":0.003732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 268.713230] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a67c97a46c845113709f222","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a67c97a46c845113709f222: start","job_status":"start","queue_duration_s":3.164522,"scheduling_latency_s":3.164546}1321gitlab # [ 268.726448] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a67c97a46c845113709f222","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a67c97a46c845113709f222: done: 0.026521 sec","job_status":"done","queue_duration_s":3.164522,"scheduling_latency_s":3.164546,"redis_calls":10,"redis_duration_s":0.002824,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026521,"completed_at":"2026-10-10T10:49:05.334Z","load_balancing_strategy":"primary","db_duration_s":0.002674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 268.767988] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bda0034413549059df0ea7f2","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bda0034413549059df0ea7f2: start","job_status":"start","queue_duration_s":3.192654,"scheduling_latency_s":3.192677}1323gitlab # [ 268.781004] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bda0034413549059df0ea7f2","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bda0034413549059df0ea7f2: done: 0.044562 sec","job_status":"done","queue_duration_s":3.192654,"scheduling_latency_s":3.192677,"redis_calls":10,"redis_duration_s":0.003511,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002097,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044562,"completed_at":"2026-10-10T10:49:05.380Z","load_balancing_strategy":"primary","db_duration_s":0.003685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 268.823626] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18c6ed79b6932b16431b7295","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18c6ed79b6932b16431b7295: start","job_status":"start","queue_duration_s":3.240242,"scheduling_latency_s":3.240265}1325gitlab # [ 268.836825] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18c6ed79b6932b16431b7295","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18c6ed79b6932b16431b7295: done: 0.034587 sec","job_status":"done","queue_duration_s":3.240242,"scheduling_latency_s":3.240265,"redis_calls":10,"redis_duration_s":0.003196,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002056,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034587,"completed_at":"2026-10-10T10:49:05.417Z","load_balancing_strategy":"primary","db_duration_s":0.002804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 268.877597] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"43bdf8a6b858660d409b990d","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-43bdf8a6b858660d409b990d: start","job_status":"start","queue_duration_s":3.279467,"scheduling_latency_s":3.279522}1327gitlab # [ 268.890610] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"43bdf8a6b858660d409b990d","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-43bdf8a6b858660d409b990d: done: 0.062356 sec","job_status":"done","queue_duration_s":3.279467,"scheduling_latency_s":3.279522,"redis_calls":10,"redis_duration_s":0.0050880000000000005,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00213,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002958,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062356,"completed_at":"2026-10-10T10:49:05.484Z","load_balancing_strategy":"primary","db_duration_s":0.011876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 268.932371] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f7fa3ce3c341148e5e969f7","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f7fa3ce3c341148e5e969f7: start","job_status":"start","queue_duration_s":3.344694,"scheduling_latency_s":3.34474}1329gitlab # [ 268.945345] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f7fa3ce3c341148e5e969f7","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f7fa3ce3c341148e5e969f7: done: 0.050659 sec","job_status":"done","queue_duration_s":3.344694,"scheduling_latency_s":3.34474,"redis_calls":10,"redis_duration_s":0.004208,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002876,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050659,"completed_at":"2026-10-10T10:49:05.538Z","load_balancing_strategy":"primary","db_duration_s":0.003538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 268.986235] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"25406e6d2c03da4b35c4962f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-25406e6d2c03da4b35c4962f: start","job_status":"start","queue_duration_s":3.39795,"scheduling_latency_s":3.397982}1331gitlab # [ 268.999415] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"25406e6d2c03da4b35c4962f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-25406e6d2c03da4b35c4962f: done: 0.042639 sec","job_status":"done","queue_duration_s":3.39795,"scheduling_latency_s":3.397982,"redis_calls":10,"redis_duration_s":0.003106,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042639,"completed_at":"2026-10-10T10:49:05.583Z","load_balancing_strategy":"primary","db_duration_s":0.00309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 269.042311] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18bd3bb7fc0f9116ff02ed51","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18bd3bb7fc0f9116ff02ed51: start","job_status":"start","queue_duration_s":3.442901,"scheduling_latency_s":3.442924}1333gitlab # [ 269.055512] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18bd3bb7fc0f9116ff02ed51","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18bd3bb7fc0f9116ff02ed51: done: 0.042228 sec","job_status":"done","queue_duration_s":3.442901,"scheduling_latency_s":3.442924,"redis_calls":10,"redis_duration_s":0.00357,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042228,"completed_at":"2026-10-10T10:49:05.628Z","load_balancing_strategy":"primary","db_duration_s":0.003743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 269.096816] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"32dadbb3d168daac081f0d7c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-32dadbb3d168daac081f0d7c: start","job_status":"start","queue_duration_s":3.487972,"scheduling_latency_s":3.487997}1335gitlab # [ 269.109790] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"32dadbb3d168daac081f0d7c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-32dadbb3d168daac081f0d7c: done: 0.033493 sec","job_status":"done","queue_duration_s":3.487972,"scheduling_latency_s":3.487997,"redis_calls":10,"redis_duration_s":0.002533,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033493,"completed_at":"2026-10-10T10:49:05.664Z","load_balancing_strategy":"primary","db_duration_s":0.002457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 269.150606] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bbb689aed9265be407ae0862","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bbb689aed9265be407ae0862: start","job_status":"start","queue_duration_s":3.523995,"scheduling_latency_s":3.524017}1337gitlab # [ 269.163403] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bbb689aed9265be407ae0862","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bbb689aed9265be407ae0862: done: 0.029426 sec","job_status":"done","queue_duration_s":3.523995,"scheduling_latency_s":3.524017,"redis_calls":10,"redis_duration_s":0.002322,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029426,"completed_at":"2026-10-10T10:49:05.696Z","load_balancing_strategy":"primary","db_duration_s":0.002199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 269.205461] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9ccaa524df6a04c9c1c5c98c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9ccaa524df6a04c9c1c5c98c: start","job_status":"start","queue_duration_s":3.555647,"scheduling_latency_s":3.555667}1339gitlab # [ 269.218520] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9ccaa524df6a04c9c1c5c98c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9ccaa524df6a04c9c1c5c98c: done: 0.027693 sec","job_status":"done","queue_duration_s":3.555647,"scheduling_latency_s":3.555667,"redis_calls":10,"redis_duration_s":0.00293,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001473,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027693,"completed_at":"2026-10-10T10:49:05.726Z","load_balancing_strategy":"primary","db_duration_s":0.002218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 269.259406] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"197ca38e0a315ce0baa75043","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-197ca38e0a315ce0baa75043: start","job_status":"start","queue_duration_s":3.585361,"scheduling_latency_s":3.585385}1341gitlab # [ 269.272511] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"197ca38e0a315ce0baa75043","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-197ca38e0a315ce0baa75043: done: 0.027585 sec","job_status":"done","queue_duration_s":3.585361,"scheduling_latency_s":3.585385,"redis_calls":10,"redis_duration_s":0.002266,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027585,"completed_at":"2026-10-10T10:49:05.756Z","load_balancing_strategy":"primary","db_duration_s":0.00218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 269.313614] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1e247b5e68dc198446a2e192","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1e247b5e68dc198446a2e192: start","job_status":"start","queue_duration_s":3.6147,"scheduling_latency_s":3.61472}1343gitlab # [ 269.326624] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1e247b5e68dc198446a2e192","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1e247b5e68dc198446a2e192: done: 0.033358 sec","job_status":"done","queue_duration_s":3.6147,"scheduling_latency_s":3.61472,"redis_calls":10,"redis_duration_s":0.0024530000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033358,"completed_at":"2026-10-10T10:49:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.00248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 269.367522] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"acef9d534a54ce388f1f0465","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-acef9d534a54ce388f1f0465: start","job_status":"start","queue_duration_s":3.650163,"scheduling_latency_s":3.650189}1345gitlab # [ 269.380656] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"acef9d534a54ce388f1f0465","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-acef9d534a54ce388f1f0465: done: 0.030447 sec","job_status":"done","queue_duration_s":3.650163,"scheduling_latency_s":3.650189,"redis_calls":10,"redis_duration_s":0.0025329999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030447,"completed_at":"2026-10-10T10:49:05.823Z","load_balancing_strategy":"primary","db_duration_s":0.002597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 269.422589] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5dd1b684f3564486ba8d0a23","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5dd1b684f3564486ba8d0a23: start","job_status":"start","queue_duration_s":3.683006,"scheduling_latency_s":3.683027}1347gitlab # [ 269.435668] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5dd1b684f3564486ba8d0a23","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5dd1b684f3564486ba8d0a23: done: 0.04451 sec","job_status":"done","queue_duration_s":3.683006,"scheduling_latency_s":3.683027,"redis_calls":10,"redis_duration_s":0.003169,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04451,"completed_at":"2026-10-10T10:49:05.870Z","load_balancing_strategy":"primary","db_duration_s":0.003449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 269.476739] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80f07a759ae994c69b2c7a3c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80f07a759ae994c69b2c7a3c: start","job_status":"start","queue_duration_s":3.729965,"scheduling_latency_s":3.729989}1349gitlab # [ 269.489601] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80f07a759ae994c69b2c7a3c","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80f07a759ae994c69b2c7a3c: done: 0.028961 sec","job_status":"done","queue_duration_s":3.729965,"scheduling_latency_s":3.729989,"redis_calls":10,"redis_duration_s":0.003097,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028961,"completed_at":"2026-10-10T10:49:05.902Z","load_balancing_strategy":"primary","db_duration_s":0.00235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 269.530141] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c2c518732f551c834365dc78","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c2c518732f551c834365dc78: start","job_status":"start","queue_duration_s":3.761987,"scheduling_latency_s":3.762012}1351gitlab # [ 269.543251] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c2c518732f551c834365dc78","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c2c518732f551c834365dc78: done: 0.0425 sec","job_status":"done","queue_duration_s":3.761987,"scheduling_latency_s":3.762012,"redis_calls":10,"redis_duration_s":0.0036090000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0425,"completed_at":"2026-10-10T10:49:05.947Z","load_balancing_strategy":"primary","db_duration_s":0.002967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 269.584645] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b2f339f09e189e3cac03c309","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b2f339f09e189e3cac03c309: start","job_status":"start","queue_duration_s":3.808256,"scheduling_latency_s":3.808297}1353gitlab # [ 269.597640] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b2f339f09e189e3cac03c309","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b2f339f09e189e3cac03c309: done: 0.032984 sec","job_status":"done","queue_duration_s":3.808256,"scheduling_latency_s":3.808297,"redis_calls":10,"redis_duration_s":0.0025830000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032984,"completed_at":"2026-10-10T10:49:05.983Z","load_balancing_strategy":"primary","db_duration_s":0.002476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 269.640078] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:05.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f2dc9f3c7f4d9145e2cc5dd","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f2dc9f3c7f4d9145e2cc5dd: start","job_status":"start","queue_duration_s":3.841845,"scheduling_latency_s":3.841864}1355gitlab # [ 269.652844] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f2dc9f3c7f4d9145e2cc5dd","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f2dc9f3c7f4d9145e2cc5dd: done: 0.024858 sec","job_status":"done","queue_duration_s":3.841845,"scheduling_latency_s":3.841864,"redis_calls":10,"redis_duration_s":0.002404,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001621,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024858,"completed_at":"2026-10-10T10:49:06.009Z","load_balancing_strategy":"primary","db_duration_s":0.001767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 269.693475] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e38cbe68dac414608a8b797e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e38cbe68dac414608a8b797e: start","job_status":"start","queue_duration_s":3.868138,"scheduling_latency_s":3.868159}1357gitlab # [ 269.706501] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e38cbe68dac414608a8b797e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e38cbe68dac414608a8b797e: done: 0.021987 sec","job_status":"done","queue_duration_s":3.868138,"scheduling_latency_s":3.868159,"redis_calls":10,"redis_duration_s":0.0020020000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021987,"completed_at":"2026-10-10T10:49:06.033Z","load_balancing_strategy":"primary","db_duration_s":0.0018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 269.747647] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a74326d75b8c3e5a27a77d4","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a74326d75b8c3e5a27a77d4: start","job_status":"start","queue_duration_s":3.891518,"scheduling_latency_s":3.891537}1359gitlab # [ 269.760786] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a74326d75b8c3e5a27a77d4","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a74326d75b8c3e5a27a77d4: done: 0.020478 sec","job_status":"done","queue_duration_s":3.891518,"scheduling_latency_s":3.891537,"redis_calls":10,"redis_duration_s":0.001898,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020478,"completed_at":"2026-10-10T10:49:06.055Z","load_balancing_strategy":"primary","db_duration_s":0.00161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 269.801294] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9530383a5c0ad72b6656397","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9530383a5c0ad72b6656397: start","job_status":"start","queue_duration_s":3.913944,"scheduling_latency_s":3.913965}1361gitlab # [ 269.814265] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9530383a5c0ad72b6656397","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9530383a5c0ad72b6656397: done: 0.021679 sec","job_status":"done","queue_duration_s":3.913944,"scheduling_latency_s":3.913965,"redis_calls":10,"redis_duration_s":0.001948,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021679,"completed_at":"2026-10-10T10:49:06.078Z","load_balancing_strategy":"primary","db_duration_s":0.00167,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 269.856377] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c2a0ed7d4f632dff795b4fb","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c2a0ed7d4f632dff795b4fb: start","job_status":"start","queue_duration_s":3.937834,"scheduling_latency_s":3.937853}1363gitlab # [ 269.869307] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c2a0ed7d4f632dff795b4fb","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c2a0ed7d4f632dff795b4fb: done: 0.021637 sec","job_status":"done","queue_duration_s":3.937834,"scheduling_latency_s":3.937853,"redis_calls":10,"redis_duration_s":0.002102,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021637,"completed_at":"2026-10-10T10:49:06.102Z","load_balancing_strategy":"primary","db_duration_s":0.001744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 269.910150] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5157915e6a353295edc1e10f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5157915e6a353295edc1e10f: start","job_status":"start","queue_duration_s":3.96083,"scheduling_latency_s":3.96085}1365gitlab # [ 269.923277] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5157915e6a353295edc1e10f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5157915e6a353295edc1e10f: done: 0.020582 sec","job_status":"done","queue_duration_s":3.96083,"scheduling_latency_s":3.96085,"redis_calls":10,"redis_duration_s":0.002314,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020582,"completed_at":"2026-10-10T10:49:06.124Z","load_balancing_strategy":"primary","db_duration_s":0.001813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 269.964799] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7a09c55ec9e2ec98be60dab8","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7a09c55ec9e2ec98be60dab8: start","job_status":"start","queue_duration_s":3.982917,"scheduling_latency_s":3.982938}1367gitlab # [ 269.977786] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7a09c55ec9e2ec98be60dab8","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7a09c55ec9e2ec98be60dab8: done: 0.020134 sec","job_status":"done","queue_duration_s":3.982917,"scheduling_latency_s":3.982938,"redis_calls":10,"redis_duration_s":0.002118,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001237,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020134,"completed_at":"2026-10-10T10:49:06.146Z","load_balancing_strategy":"primary","db_duration_s":0.001807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 270.018630] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9e8d12b3c83309ca59b2349","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9e8d12b3c83309ca59b2349: start","job_status":"start","queue_duration_s":4.004518,"scheduling_latency_s":4.004539}1369gitlab # [ 270.032879] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9e8d12b3c83309ca59b2349","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9e8d12b3c83309ca59b2349: done: 0.019116 sec","job_status":"done","queue_duration_s":4.004518,"scheduling_latency_s":4.004539,"redis_calls":10,"redis_duration_s":0.0018059999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019116,"completed_at":"2026-10-10T10:49:06.166Z","load_balancing_strategy":"primary","db_duration_s":0.001639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 270.073627] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"42db76f53706907a9510b8cb","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-42db76f53706907a9510b8cb: start","job_status":"start","queue_duration_s":4.024883,"scheduling_latency_s":4.024903}1371gitlab # [ 270.086676] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"42db76f53706907a9510b8cb","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-42db76f53706907a9510b8cb: done: 0.020491 sec","job_status":"done","queue_duration_s":4.024883,"scheduling_latency_s":4.024903,"redis_calls":10,"redis_duration_s":0.001827,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020491,"completed_at":"2026-10-10T10:49:06.188Z","load_balancing_strategy":"primary","db_duration_s":0.003668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 270.127633] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbea5b82f02107472a38517f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbea5b82f02107472a38517f: start","job_status":"start","queue_duration_s":4.046778,"scheduling_latency_s":4.046797}1373gitlab # [ 270.140769] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbea5b82f02107472a38517f","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbea5b82f02107472a38517f: done: 0.019148 sec","job_status":"done","queue_duration_s":4.046778,"scheduling_latency_s":4.046797,"redis_calls":10,"redis_duration_s":0.001914,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019148,"completed_at":"2026-10-10T10:49:06.209Z","load_balancing_strategy":"primary","db_duration_s":0.001783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 270.181130] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"220951c31aa24fb380bb33e6","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-220951c31aa24fb380bb33e6: start","job_status":"start","queue_duration_s":4.067265,"scheduling_latency_s":4.067284}1375gitlab # [ 270.194103] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"220951c31aa24fb380bb33e6","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-220951c31aa24fb380bb33e6: done: 0.018969 sec","job_status":"done","queue_duration_s":4.067265,"scheduling_latency_s":4.067284,"redis_calls":10,"redis_duration_s":0.002123,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018969,"completed_at":"2026-10-10T10:49:06.229Z","load_balancing_strategy":"primary","db_duration_s":0.001667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 270.239264] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"601f4eb454034219c5877639","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-601f4eb454034219c5877639: start","job_status":"start","queue_duration_s":4.087571,"scheduling_latency_s":4.08759}1377gitlab # [ 270.253491] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"601f4eb454034219c5877639","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-601f4eb454034219c5877639: done: 0.019754 sec","job_status":"done","queue_duration_s":4.087571,"scheduling_latency_s":4.08759,"redis_calls":10,"redis_duration_s":0.002635,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019754,"completed_at":"2026-10-10T10:49:06.250Z","load_balancing_strategy":"primary","db_duration_s":0.001726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 270.296927] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a0eebb0517420d65c90f74e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a0eebb0517420d65c90f74e: start","job_status":"start","queue_duration_s":4.10876,"scheduling_latency_s":4.108779}1379gitlab # [ 270.310823] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a0eebb0517420d65c90f74e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a0eebb0517420d65c90f74e: done: 0.018901 sec","job_status":"done","queue_duration_s":4.10876,"scheduling_latency_s":4.108779,"redis_calls":10,"redis_duration_s":0.001934,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018901,"completed_at":"2026-10-10T10:49:06.270Z","load_balancing_strategy":"primary","db_duration_s":0.001651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 270.353079] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c4da29001858f87d4d272911","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c4da29001858f87d4d272911: start","job_status":"start","queue_duration_s":4.12908,"scheduling_latency_s":4.129099}1381gitlab # [ 270.366528] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c4da29001858f87d4d272911","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c4da29001858f87d4d272911: done: 0.019219 sec","job_status":"done","queue_duration_s":4.12908,"scheduling_latency_s":4.129099,"redis_calls":10,"redis_duration_s":0.0019760000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019219,"completed_at":"2026-10-10T10:49:06.291Z","load_balancing_strategy":"primary","db_duration_s":0.001728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 270.411132] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aaae323fe0b39664ca4f2831","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aaae323fe0b39664ca4f2831: start","job_status":"start","queue_duration_s":4.149745,"scheduling_latency_s":4.149765}1383gitlab # [ 270.425459] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aaae323fe0b39664ca4f2831","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aaae323fe0b39664ca4f2831: done: 0.019574 sec","job_status":"done","queue_duration_s":4.149745,"scheduling_latency_s":4.149765,"redis_calls":10,"redis_duration_s":0.002046,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019574,"completed_at":"2026-10-10T10:49:06.312Z","load_balancing_strategy":"primary","db_duration_s":0.001739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 270.470349] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37c903c16803410e53d5933a","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37c903c16803410e53d5933a: start","job_status":"start","queue_duration_s":4.170649,"scheduling_latency_s":4.170666}1385gitlab # [ 270.483683] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37c903c16803410e53d5933a","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37c903c16803410e53d5933a: done: 0.019474 sec","job_status":"done","queue_duration_s":4.170649,"scheduling_latency_s":4.170666,"redis_calls":10,"redis_duration_s":0.002099,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019474,"completed_at":"2026-10-10T10:49:06.333Z","load_balancing_strategy":"primary","db_duration_s":0.002826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 270.525766] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"370d5d18bc0e25f4c04ac624","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-370d5d18bc0e25f4c04ac624: start","job_status":"start","queue_duration_s":4.19148,"scheduling_latency_s":4.191499}1387gitlab # [ 270.539064] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"370d5d18bc0e25f4c04ac624","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-370d5d18bc0e25f4c04ac624: done: 0.018396 sec","job_status":"done","queue_duration_s":4.19148,"scheduling_latency_s":4.191499,"redis_calls":10,"redis_duration_s":0.001813,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018396,"completed_at":"2026-10-10T10:49:06.352Z","load_balancing_strategy":"primary","db_duration_s":0.001572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 270.582881] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c488ee804228d02160b0d1a7","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c488ee804228d02160b0d1a7: start","job_status":"start","queue_duration_s":4.211267,"scheduling_latency_s":4.211287}1389gitlab # [ 270.596975] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c488ee804228d02160b0d1a7","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c488ee804228d02160b0d1a7: done: 0.019118 sec","job_status":"done","queue_duration_s":4.211267,"scheduling_latency_s":4.211287,"redis_calls":10,"redis_duration_s":0.001944,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019118,"completed_at":"2026-10-10T10:49:06.373Z","load_balancing_strategy":"primary","db_duration_s":0.0017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 270.642163] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bcd290da6921c9f08ad28596","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bcd290da6921c9f08ad28596: start","job_status":"start","queue_duration_s":4.231792,"scheduling_latency_s":4.231833}1391gitlab # [ 270.656969] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bcd290da6921c9f08ad28596","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bcd290da6921c9f08ad28596: done: 0.018426 sec","job_status":"done","queue_duration_s":4.231792,"scheduling_latency_s":4.231833,"redis_calls":10,"redis_duration_s":0.001817,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018426,"completed_at":"2026-10-10T10:49:06.393Z","load_balancing_strategy":"primary","db_duration_s":0.001595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 270.700991] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c7e3828f99bd2476c023367e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c7e3828f99bd2476c023367e: start","job_status":"start","queue_duration_s":4.251598,"scheduling_latency_s":4.251616}1393gitlab # [ 270.714723] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c7e3828f99bd2476c023367e","created_at":"2026-10-10T10:49:01.980Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-7468e902322243cf","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"0c5f7920c8ba782cd910915979cdab8e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.143Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c7e3828f99bd2476c023367e: done: 0.018547 sec","job_status":"done","queue_duration_s":4.251598,"scheduling_latency_s":4.251616,"redis_calls":10,"redis_duration_s":0.001807,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018547,"completed_at":"2026-10-10T10:49:06.413Z","load_balancing_strategy":"primary","db_duration_s":0.0016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 270.759098] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aaeb680a59eaf2d5b7efaaf","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aaeb680a59eaf2d5b7efaaf: start","job_status":"start","queue_duration_s":4.066596,"scheduling_latency_s":4.066615}1395gitlab # [ 270.773616] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aaeb680a59eaf2d5b7efaaf","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aaeb680a59eaf2d5b7efaaf: done: 0.022717 sec","job_status":"done","queue_duration_s":4.066596,"scheduling_latency_s":4.066615,"redis_calls":16,"redis_duration_s":0.003349,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029408,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022717,"completed_at":"2026-10-10T10:49:06.437Z","load_balancing_strategy":"primary","db_duration_s":0.000513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 270.820394] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"544281843a91ac049e76ef89","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-544281843a91ac049e76ef89: start","job_status":"start","queue_duration_s":4.090742,"scheduling_latency_s":4.090759}1397gitlab # [ 270.833873] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"544281843a91ac049e76ef89","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-544281843a91ac049e76ef89: done: 0.015546 sec","job_status":"done","queue_duration_s":4.090742,"scheduling_latency_s":4.090759,"redis_calls":13,"redis_duration_s":0.002106,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001341,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015546,"completed_at":"2026-10-10T10:49:06.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 270.877975] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685530634eadfbb0d4774e3c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685530634eadfbb0d4774e3c: start","job_status":"start","queue_duration_s":4.107751,"scheduling_latency_s":4.10777}1399gitlab # [ 270.891476] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685530634eadfbb0d4774e3c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685530634eadfbb0d4774e3c: done: 0.015298 sec","job_status":"done","queue_duration_s":4.107751,"scheduling_latency_s":4.10777,"redis_calls":13,"redis_duration_s":0.0022259999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015298,"completed_at":"2026-10-10T10:49:06.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 270.936138] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cd8f5ed84e9d4b0acd2348c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cd8f5ed84e9d4b0acd2348c: start","job_status":"start","queue_duration_s":4.124385,"scheduling_latency_s":4.124402}1401gitlab # [ 270.950305] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cd8f5ed84e9d4b0acd2348c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cd8f5ed84e9d4b0acd2348c: done: 0.022063 sec","job_status":"done","queue_duration_s":4.124385,"scheduling_latency_s":4.124402,"redis_calls":13,"redis_duration_s":0.008228,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022063,"completed_at":"2026-10-10T10:49:06.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 270.994966] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c9342a9ff3ce03fea016d7e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c9342a9ff3ce03fea016d7e: start","job_status":"start","queue_duration_s":4.151939,"scheduling_latency_s":4.151961}1403gitlab # [ 271.008659] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c9342a9ff3ce03fea016d7e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c9342a9ff3ce03fea016d7e: done: 0.023913 sec","job_status":"done","queue_duration_s":4.151939,"scheduling_latency_s":4.151961,"redis_calls":13,"redis_duration_s":0.004548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003671,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023913,"completed_at":"2026-10-10T10:49:06.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 271.053112] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff318eb3dd79c1d24f4d16fd","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff318eb3dd79c1d24f4d16fd: start","job_status":"start","queue_duration_s":4.178292,"scheduling_latency_s":4.178314}1405gitlab # [ 271.067391] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff318eb3dd79c1d24f4d16fd","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff318eb3dd79c1d24f4d16fd: done: 0.016438 sec","job_status":"done","queue_duration_s":4.178292,"scheduling_latency_s":4.178314,"redis_calls":13,"redis_duration_s":0.002142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001384,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016438,"completed_at":"2026-10-10T10:49:06.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 271.112811] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b4382cff11eff8ec970c3e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b4382cff11eff8ec970c3e: start","job_status":"start","queue_duration_s":4.196167,"scheduling_latency_s":4.196189}1407gitlab # [ 271.127366] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83b4382cff11eff8ec970c3e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83b4382cff11eff8ec970c3e: done: 0.017791 sec","job_status":"done","queue_duration_s":4.196167,"scheduling_latency_s":4.196189,"redis_calls":13,"redis_duration_s":0.0021910000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017791,"completed_at":"2026-10-10T10:49:06.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 271.173435] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3b873bc04647bd100b0cc4b","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3b873bc04647bd100b0cc4b: start","job_status":"start","queue_duration_s":4.215485,"scheduling_latency_s":4.215506}1409gitlab # [ 271.187492] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3b873bc04647bd100b0cc4b","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3b873bc04647bd100b0cc4b: done: 0.019591 sec","job_status":"done","queue_duration_s":4.215485,"scheduling_latency_s":4.215506,"redis_calls":13,"redis_duration_s":0.002374,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001491,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019591,"completed_at":"2026-10-10T10:49:06.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 271.230242] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e004de1f5d81c05d13266e75","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e004de1f5d81c05d13266e75: start","job_status":"start","queue_duration_s":4.236771,"scheduling_latency_s":4.236797}1411gitlab # [ 271.243738] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e004de1f5d81c05d13266e75","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e004de1f5d81c05d13266e75: done: 0.021458 sec","job_status":"done","queue_duration_s":4.236771,"scheduling_latency_s":4.236797,"redis_calls":13,"redis_duration_s":0.002525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021458,"completed_at":"2026-10-10T10:49:06.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 271.289776] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"603bc7db47d407140340679a","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-603bc7db47d407140340679a: start","job_status":"start","queue_duration_s":4.260105,"scheduling_latency_s":4.260133}1413gitlab # [ 271.311621] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"603bc7db47d407140340679a","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-603bc7db47d407140340679a: done: 0.027904 sec","job_status":"done","queue_duration_s":4.260105,"scheduling_latency_s":4.260133,"redis_calls":13,"redis_duration_s":0.00372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027904,"completed_at":"2026-10-10T10:49:06.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 271.371834] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52275954fa8e3f699bbbb1bf","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52275954fa8e3f699bbbb1bf: start","job_status":"start","queue_duration_s":4.290022,"scheduling_latency_s":4.290051}1415gitlab # [ 271.386454] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52275954fa8e3f699bbbb1bf","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52275954fa8e3f699bbbb1bf: done: 0.019756 sec","job_status":"done","queue_duration_s":4.290022,"scheduling_latency_s":4.290051,"redis_calls":13,"redis_duration_s":0.002321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019756,"completed_at":"2026-10-10T10:49:06.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 271.429523] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17f92b7fe9e2a96bd2be057","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17f92b7fe9e2a96bd2be057: start","job_status":"start","queue_duration_s":4.311191,"scheduling_latency_s":4.311212}1417gitlab # [ 271.443855] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17f92b7fe9e2a96bd2be057","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17f92b7fe9e2a96bd2be057: done: 0.015674 sec","job_status":"done","queue_duration_s":4.311191,"scheduling_latency_s":4.311212,"redis_calls":13,"redis_duration_s":0.001894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015674,"completed_at":"2026-10-10T10:49:06.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 271.489143] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f1cfeceddb42529966cfb0","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f1cfeceddb42529966cfb0: start","job_status":"start","queue_duration_s":4.328423,"scheduling_latency_s":4.328445}1419gitlab # [ 271.503533] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f1cfeceddb42529966cfb0","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f1cfeceddb42529966cfb0: done: 0.015691 sec","job_status":"done","queue_duration_s":4.328423,"scheduling_latency_s":4.328445,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015691,"completed_at":"2026-10-10T10:49:06.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 271.549286] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"215b75bf27ab56b5f44d1616","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-215b75bf27ab56b5f44d1616: start","job_status":"start","queue_duration_s":4.345578,"scheduling_latency_s":4.345599}1421gitlab # [ 271.563250] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"215b75bf27ab56b5f44d1616","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-215b75bf27ab56b5f44d1616: done: 0.015811 sec","job_status":"done","queue_duration_s":4.345578,"scheduling_latency_s":4.345599,"redis_calls":13,"redis_duration_s":0.00199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015811,"completed_at":"2026-10-10T10:49:06.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 271.606025] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6572e342e60d57d61e0ae5","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6572e342e60d57d61e0ae5: start","job_status":"start","queue_duration_s":4.362777,"scheduling_latency_s":4.362797}1423gitlab # [ 271.619780] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6572e342e60d57d61e0ae5","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6572e342e60d57d61e0ae5: done: 0.017001 sec","job_status":"done","queue_duration_s":4.362777,"scheduling_latency_s":4.362797,"redis_calls":13,"redis_duration_s":0.002305,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017001,"completed_at":"2026-10-10T10:49:06.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 271.665175] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3635e88308e2f139cd8e6b1","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3635e88308e2f139cd8e6b1: start","job_status":"start","queue_duration_s":4.381269,"scheduling_latency_s":4.38129}1425gitlab # [ 271.680451] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3635e88308e2f139cd8e6b1","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3635e88308e2f139cd8e6b1: done: 0.016684 sec","job_status":"done","queue_duration_s":4.381269,"scheduling_latency_s":4.38129,"redis_calls":13,"redis_duration_s":0.002022,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016684,"completed_at":"2026-10-10T10:49:06.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 271.724380] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3615207b4b0af043e7704","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3615207b4b0af043e7704: start","job_status":"start","queue_duration_s":4.399439,"scheduling_latency_s":4.39946}1427gitlab # [ 271.737613] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3615207b4b0af043e7704","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3615207b4b0af043e7704: done: 0.016797 sec","job_status":"done","queue_duration_s":4.399439,"scheduling_latency_s":4.39946,"redis_calls":13,"redis_duration_s":0.002079,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001371,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016797,"completed_at":"2026-10-10T10:49:06.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 271.780044] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4835a71c0a4f4d2ed892be","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4835a71c0a4f4d2ed892be: start","job_status":"start","queue_duration_s":4.417754,"scheduling_latency_s":4.417775}1429gitlab # [ 271.793321] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4835a71c0a4f4d2ed892be","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4835a71c0a4f4d2ed892be: done: 0.016808 sec","job_status":"done","queue_duration_s":4.417754,"scheduling_latency_s":4.417775,"redis_calls":13,"redis_duration_s":0.002262,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001534,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016808,"completed_at":"2026-10-10T10:49:06.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 271.835281] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eb6c68ffa5d136595c1536c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eb6c68ffa5d136595c1536c: start","job_status":"start","queue_duration_s":4.43602,"scheduling_latency_s":4.436041}1431gitlab # [ 271.848697] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eb6c68ffa5d136595c1536c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eb6c68ffa5d136595c1536c: done: 0.019474 sec","job_status":"done","queue_duration_s":4.43602,"scheduling_latency_s":4.436041,"redis_calls":13,"redis_duration_s":0.0031799999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019474,"completed_at":"2026-10-10T10:49:06.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 271.891409] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e8d348e7044f949c2f5d4d","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e8d348e7044f949c2f5d4d: start","job_status":"start","queue_duration_s":4.457239,"scheduling_latency_s":4.457262}1433gitlab # [ 271.904841] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e8d348e7044f949c2f5d4d","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e8d348e7044f949c2f5d4d: done: 0.017153 sec","job_status":"done","queue_duration_s":4.457239,"scheduling_latency_s":4.457262,"redis_calls":13,"redis_duration_s":0.002151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001383,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017153,"completed_at":"2026-10-10T10:49:06.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 271.946196] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2360e035dfd82284936e48d5","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2360e035dfd82284936e48d5: start","job_status":"start","queue_duration_s":4.476127,"scheduling_latency_s":4.47615}1435gitlab # [ 271.959426] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2360e035dfd82284936e48d5","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2360e035dfd82284936e48d5: done: 0.016612 sec","job_status":"done","queue_duration_s":4.476127,"scheduling_latency_s":4.47615,"redis_calls":13,"redis_duration_s":0.0019649999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016612,"completed_at":"2026-10-10T10:49:06.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 272.002116] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25b7dd608189ae49d2d8139","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25b7dd608189ae49d2d8139: start","job_status":"start","queue_duration_s":4.494478,"scheduling_latency_s":4.494499}1437gitlab # [ 272.015480] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25b7dd608189ae49d2d8139","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25b7dd608189ae49d2d8139: done: 0.01584 sec","job_status":"done","queue_duration_s":4.494478,"scheduling_latency_s":4.494499,"redis_calls":13,"redis_duration_s":0.002023,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001358,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01584,"completed_at":"2026-10-10T10:49:06.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 272.057421] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad09d20a2a8bc3a781dcbb30","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad09d20a2a8bc3a781dcbb30: start","job_status":"start","queue_duration_s":4.511913,"scheduling_latency_s":4.511935}1439gitlab # [ 272.070579] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad09d20a2a8bc3a781dcbb30","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad09d20a2a8bc3a781dcbb30: done: 0.016013 sec","job_status":"done","queue_duration_s":4.511913,"scheduling_latency_s":4.511935,"redis_calls":13,"redis_duration_s":0.002066,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016013,"completed_at":"2026-10-10T10:49:06.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 272.113393] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e84d05b348162bc72d13db49","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e84d05b348162bc72d13db49: start","job_status":"start","queue_duration_s":4.529519,"scheduling_latency_s":4.529541}1441gitlab # [ 272.126759] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e84d05b348162bc72d13db49","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e84d05b348162bc72d13db49: done: 0.016104 sec","job_status":"done","queue_duration_s":4.529519,"scheduling_latency_s":4.529541,"redis_calls":13,"redis_duration_s":0.002011,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016104,"completed_at":"2026-10-10T10:49:06.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 272.168919] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cdbf5bb52e8a65bde3c0371","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cdbf5bb52e8a65bde3c0371: start","job_status":"start","queue_duration_s":4.547059,"scheduling_latency_s":4.547079}1443gitlab # [ 272.182088] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cdbf5bb52e8a65bde3c0371","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cdbf5bb52e8a65bde3c0371: done: 0.015867 sec","job_status":"done","queue_duration_s":4.547059,"scheduling_latency_s":4.547079,"redis_calls":13,"redis_duration_s":0.0020759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015867,"completed_at":"2026-10-10T10:49:06.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 272.224152] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0775cbfdcf4268b39f01c314","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0775cbfdcf4268b39f01c314: start","job_status":"start","queue_duration_s":4.564379,"scheduling_latency_s":4.5644}1445gitlab # [ 272.237117] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0775cbfdcf4268b39f01c314","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0775cbfdcf4268b39f01c314: done: 0.01649 sec","job_status":"done","queue_duration_s":4.564379,"scheduling_latency_s":4.5644,"redis_calls":13,"redis_duration_s":0.002326,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00158,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01649,"completed_at":"2026-10-10T10:49:06.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 272.278763] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4ac89078f2d6fccca099ad","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4ac89078f2d6fccca099ad: start","job_status":"start","queue_duration_s":4.58229,"scheduling_latency_s":4.58231}1447gitlab # [ 272.292988] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4ac89078f2d6fccca099ad","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4ac89078f2d6fccca099ad: done: 0.01634 sec","job_status":"done","queue_duration_s":4.58229,"scheduling_latency_s":4.58231,"redis_calls":13,"redis_duration_s":0.002317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01634,"completed_at":"2026-10-10T10:49:06.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 272.334618] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9abcafb7e885a3d27642c09d","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9abcafb7e885a3d27642c09d: start","job_status":"start","queue_duration_s":4.600145,"scheduling_latency_s":4.600166}1449gitlab # [ 272.347990] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9abcafb7e885a3d27642c09d","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9abcafb7e885a3d27642c09d: done: 0.016644 sec","job_status":"done","queue_duration_s":4.600145,"scheduling_latency_s":4.600166,"redis_calls":13,"redis_duration_s":0.002109,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016644,"completed_at":"2026-10-10T10:49:06.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 272.392522] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74578779735f1564d7754c11","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74578779735f1564d7754c11: start","job_status":"start","queue_duration_s":4.618252,"scheduling_latency_s":4.618273}1451gitlab # [ 272.405917] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74578779735f1564d7754c11","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74578779735f1564d7754c11: done: 0.015973 sec","job_status":"done","queue_duration_s":4.618252,"scheduling_latency_s":4.618273,"redis_calls":13,"redis_duration_s":0.0022199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015973,"completed_at":"2026-10-10T10:49:06.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 272.449045] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a52c69137aa0e15f0f364bb","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a52c69137aa0e15f0f364bb: start","job_status":"start","queue_duration_s":4.635743,"scheduling_latency_s":4.635763}1453gitlab # [ 272.463264] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:06.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a52c69137aa0e15f0f364bb","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a52c69137aa0e15f0f364bb: done: 0.015483 sec","job_status":"done","queue_duration_s":4.635743,"scheduling_latency_s":4.635763,"redis_calls":13,"redis_duration_s":0.0019320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015483,"completed_at":"2026-10-10T10:49:06.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 272.509512] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8777d036997f8bd4c9f1ff15","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8777d036997f8bd4c9f1ff15: start","job_status":"start","queue_duration_s":4.653354,"scheduling_latency_s":4.653374}1455gitlab # [ 272.523892] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8777d036997f8bd4c9f1ff15","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8777d036997f8bd4c9f1ff15: done: 0.016106 sec","job_status":"done","queue_duration_s":4.653354,"scheduling_latency_s":4.653374,"redis_calls":13,"redis_duration_s":0.001973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016106,"completed_at":"2026-10-10T10:49:07.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 272.566912] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e0e30263a969f699c18592","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e0e30263a969f699c18592: start","job_status":"start","queue_duration_s":4.671079,"scheduling_latency_s":4.6711}1457gitlab # [ 272.580464] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e0e30263a969f699c18592","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e0e30263a969f699c18592: done: 0.016281 sec","job_status":"done","queue_duration_s":4.671079,"scheduling_latency_s":4.6711,"redis_calls":13,"redis_duration_s":0.0023480000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001618,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016281,"completed_at":"2026-10-10T10:49:07.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 272.623697] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0454482cbfc0711abdcf799","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0454482cbfc0711abdcf799: start","job_status":"start","queue_duration_s":4.688999,"scheduling_latency_s":4.689018}1459gitlab # [ 272.638166] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0454482cbfc0711abdcf799","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0454482cbfc0711abdcf799: done: 0.015705 sec","job_status":"done","queue_duration_s":4.688999,"scheduling_latency_s":4.689018,"redis_calls":13,"redis_duration_s":0.0019950000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015705,"completed_at":"2026-10-10T10:49:07.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 272.682167] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdf8d89626b6c37098c6d890","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdf8d89626b6c37098c6d890: start","job_status":"start","queue_duration_s":4.706284,"scheduling_latency_s":4.706302}1461gitlab # [ 272.696556] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdf8d89626b6c37098c6d890","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdf8d89626b6c37098c6d890: done: 0.015888 sec","job_status":"done","queue_duration_s":4.706284,"scheduling_latency_s":4.706302,"redis_calls":13,"redis_duration_s":0.002282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001373,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015888,"completed_at":"2026-10-10T10:49:07.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 272.739149] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4a9b93d772a696af6aa26e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4a9b93d772a696af6aa26e: start","job_status":"start","queue_duration_s":4.723552,"scheduling_latency_s":4.72357}1463gitlab # [ 272.753182] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4a9b93d772a696af6aa26e","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4a9b93d772a696af6aa26e: done: 0.016342 sec","job_status":"done","queue_duration_s":4.723552,"scheduling_latency_s":4.72357,"redis_calls":13,"redis_duration_s":0.0020759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016342,"completed_at":"2026-10-10T10:49:07.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 272.798895] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f342171ab958484568a49c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f342171ab958484568a49c: start","job_status":"start","queue_duration_s":4.74131,"scheduling_latency_s":4.741328}1465gitlab # [ 272.813409] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f342171ab958484568a49c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f342171ab958484568a49c: done: 0.016295 sec","job_status":"done","queue_duration_s":4.74131,"scheduling_latency_s":4.741328,"redis_calls":13,"redis_duration_s":0.0020759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016295,"completed_at":"2026-10-10T10:49:07.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 272.857748] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5f55ab1a23e3e8a52cae22a","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5f55ab1a23e3e8a52cae22a: start","job_status":"start","queue_duration_s":4.759051,"scheduling_latency_s":4.759069}1467gitlab # [ 272.871214] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5f55ab1a23e3e8a52cae22a","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5f55ab1a23e3e8a52cae22a: done: 0.016739 sec","job_status":"done","queue_duration_s":4.759051,"scheduling_latency_s":4.759069,"redis_calls":13,"redis_duration_s":0.002293,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001454,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016739,"completed_at":"2026-10-10T10:49:07.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 272.914189] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47ed0553fb35bef8d6ae5ce1","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47ed0553fb35bef8d6ae5ce1: start","job_status":"start","queue_duration_s":4.777573,"scheduling_latency_s":4.777593}1469gitlab # [ 272.927486] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47ed0553fb35bef8d6ae5ce1","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47ed0553fb35bef8d6ae5ce1: done: 0.016484 sec","job_status":"done","queue_duration_s":4.777573,"scheduling_latency_s":4.777593,"redis_calls":13,"redis_duration_s":0.002128,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016484,"completed_at":"2026-10-10T10:49:07.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 272.969580] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25f3bedac2b408b75dc09b9","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25f3bedac2b408b75dc09b9: start","job_status":"start","queue_duration_s":4.795481,"scheduling_latency_s":4.7955}1471gitlab # [ 272.982816] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e25f3bedac2b408b75dc09b9","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e25f3bedac2b408b75dc09b9: done: 0.015083 sec","job_status":"done","queue_duration_s":4.795481,"scheduling_latency_s":4.7955,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015083,"completed_at":"2026-10-10T10:49:07.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 273.025101] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7889caffd7686fb0574cd37","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7889caffd7686fb0574cd37: start","job_status":"start","queue_duration_s":4.811928,"scheduling_latency_s":4.811945}1473gitlab # [ 273.038423] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7889caffd7686fb0574cd37","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7889caffd7686fb0574cd37: done: 0.014742 sec","job_status":"done","queue_duration_s":4.811928,"scheduling_latency_s":4.811945,"redis_calls":13,"redis_duration_s":0.0019360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001275,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014742,"completed_at":"2026-10-10T10:49:07.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 273.080668] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97853eed9ece663d63bc73d4","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97853eed9ece663d63bc73d4: start","job_status":"start","queue_duration_s":4.828063,"scheduling_latency_s":4.828081}1475gitlab # [ 273.093975] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97853eed9ece663d63bc73d4","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97853eed9ece663d63bc73d4: done: 0.015017 sec","job_status":"done","queue_duration_s":4.828063,"scheduling_latency_s":4.828081,"redis_calls":13,"redis_duration_s":0.001925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015017,"completed_at":"2026-10-10T10:49:07.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 273.137078] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d153ede7f5dfce938a63a30","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d153ede7f5dfce938a63a30: start","job_status":"start","queue_duration_s":4.844539,"scheduling_latency_s":4.844556}1477gitlab # [ 273.150247] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d153ede7f5dfce938a63a30","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d153ede7f5dfce938a63a30: done: 0.015446 sec","job_status":"done","queue_duration_s":4.844539,"scheduling_latency_s":4.844556,"redis_calls":13,"redis_duration_s":0.002001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001325,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015446,"completed_at":"2026-10-10T10:49:07.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 273.191993] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f18f6cbb5a2cb9ca1f6a5dc","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f18f6cbb5a2cb9ca1f6a5dc: start","job_status":"start","queue_duration_s":4.861442,"scheduling_latency_s":4.86146}1479gitlab # [ 273.205212] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f18f6cbb5a2cb9ca1f6a5dc","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f18f6cbb5a2cb9ca1f6a5dc: done: 0.01495 sec","job_status":"done","queue_duration_s":4.861442,"scheduling_latency_s":4.86146,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01495,"completed_at":"2026-10-10T10:49:07.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 273.246873] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cf1c4d363b912212b64590c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cf1c4d363b912212b64590c: start","job_status":"start","queue_duration_s":4.878044,"scheduling_latency_s":4.878061}1481gitlab # [ 273.260362] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cf1c4d363b912212b64590c","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cf1c4d363b912212b64590c: done: 0.01561 sec","job_status":"done","queue_duration_s":4.878044,"scheduling_latency_s":4.878061,"redis_calls":13,"redis_duration_s":0.0021330000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01561,"completed_at":"2026-10-10T10:49:07.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 273.301725] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc423060aacdbadb9fda3ea4","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc423060aacdbadb9fda3ea4: start","job_status":"start","queue_duration_s":4.895038,"scheduling_latency_s":4.895057}1483gitlab # [ 273.315809] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc423060aacdbadb9fda3ea4","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc423060aacdbadb9fda3ea4: done: 0.016501 sec","job_status":"done","queue_duration_s":4.895038,"scheduling_latency_s":4.895057,"redis_calls":13,"redis_duration_s":0.002136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016501,"completed_at":"2026-10-10T10:49:07.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 273.357667] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f7e6888fc6ea0c53c86554b","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f7e6888fc6ea0c53c86554b: start","job_status":"start","queue_duration_s":4.912965,"scheduling_latency_s":4.912983}1485gitlab # [ 273.370946] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f7e6888fc6ea0c53c86554b","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f7e6888fc6ea0c53c86554b: done: 0.01693 sec","job_status":"done","queue_duration_s":4.912965,"scheduling_latency_s":4.912983,"redis_calls":13,"redis_duration_s":0.002149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001394,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01693,"completed_at":"2026-10-10T10:49:07.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 273.412914] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53de628d566d44c5e8e8fead","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53de628d566d44c5e8e8fead: start","job_status":"start","queue_duration_s":4.931297,"scheduling_latency_s":4.931317}1487gitlab # [ 273.426317] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53de628d566d44c5e8e8fead","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53de628d566d44c5e8e8fead: done: 0.017354 sec","job_status":"done","queue_duration_s":4.931297,"scheduling_latency_s":4.931317,"redis_calls":13,"redis_duration_s":0.0023940000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017354,"completed_at":"2026-10-10T10:49:07.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 273.468020] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0bc166cb63316fc99cabd99","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0bc166cb63316fc99cabd99: start","job_status":"start","queue_duration_s":4.950026,"scheduling_latency_s":4.950046}1489gitlab # [ 273.481178] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0bc166cb63316fc99cabd99","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0bc166cb63316fc99cabd99: done: 0.016887 sec","job_status":"done","queue_duration_s":4.950026,"scheduling_latency_s":4.950046,"redis_calls":13,"redis_duration_s":0.002223,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016887,"completed_at":"2026-10-10T10:49:07.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 273.523625] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53b598deb109116ef0b81c22","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53b598deb109116ef0b81c22: start","job_status":"start","queue_duration_s":4.96832,"scheduling_latency_s":4.968339}1491gitlab # [ 273.536951] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53b598deb109116ef0b81c22","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53b598deb109116ef0b81c22: done: 0.016141 sec","job_status":"done","queue_duration_s":4.96832,"scheduling_latency_s":4.968339,"redis_calls":13,"redis_duration_s":0.0023629999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016141,"completed_at":"2026-10-10T10:49:07.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 273.578660] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d4ea8bf0f0905f6762d456","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d4ea8bf0f0905f6762d456: start","job_status":"start","queue_duration_s":4.985849,"scheduling_latency_s":4.985866}1493gitlab # [ 273.592034] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:07.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d4ea8bf0f0905f6762d456","created_at":"2026-10-10T10:49:02.205Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-53acc08fb19c4792","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3a68fef69a7ad8727cb24c840123f196","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:49:02.348Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d4ea8bf0f0905f6762d456: done: 0.014765 sec","job_status":"done","queue_duration_s":4.985849,"scheduling_latency_s":4.985866,"redis_calls":13,"redis_duration_s":0.001904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014765,"completed_at":"2026-10-10T10:49:07.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 273.633394] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:09.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"2c1e30c8396dad4472a061ca","created_at":"2026-10-10T10:49:09.562Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4532dba558f36353ac4987b0068a3495","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:09.575Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-2c1e30c8396dad4472a061ca: start","job_status":"start","queue_duration_s":0.006336,"scheduling_latency_s":0.006375}1495gitlab # [ 273.648512] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:49:09.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"2c1e30c8396dad4472a061ca","created_at":"2026-10-10T10:49:09.562Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4532dba558f36353ac4987b0068a3495","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-10T10:49:09.575Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-2c1e30c8396dad4472a061ca: done: 0.273979 sec","job_status":"done","queue_duration_s":0.006336,"scheduling_latency_s":0.006375,"redis_calls":12,"redis_duration_s":0.002768,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.20641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088708,"exclusive_lock_hold_duration_s":0.19463602,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.273979,"completed_at":"2026-10-10T10:49:09.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021693,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1496gitlab # [ 307.413988] setup-gitlab-start[3262]: W, [2026-10-10T10:49:44.280084 #3262] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1497gitlab # [ 308.150481] redis[792]: 10 changes in 300 seconds. Saving...1498gitlab # [ 308.150782] redis[792]: Background saving started by pid 34881499gitlab # [ 308.156931] redis[3488]: BGSAVE done, 445 keys saved, 0 keys skipped, 116950 bytes written.1500gitlab # [ 308.160449] redis[3488]: DB saved on disk1501gitlab # [ 308.161739] redis[3488]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1502gitlab # [ 308.251430] redis[792]: Background saving terminated with success1503gitlab # [ 309.982225] postgres[860]: [860] LOG: checkpoint starting: time1504gitlab # [ 311.151820] gitaly[903]: time="2026-10-10T10:49:48.017Z" level=info msg="burden monitor stats" pid=9031505gitlab # [ 328.454520] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"eba99035f893001bda76adae","created_at":"2026-10-10T10:50:05.268Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.317Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-eba99035f893001bda76adae: start","job_status":"start","queue_duration_s":0.002568,"scheduling_latency_s":0.002614}1506gitlab # [ 328.727589] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"eba99035f893001bda76adae","created_at":"2026-10-10T10:50:05.268Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.317Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-eba99035f893001bda76adae: done: 0.273329 sec","job_status":"done","queue_duration_s":0.002568,"scheduling_latency_s":0.002614,"redis_calls":29,"redis_duration_s":0.035196000000000005,"redis_read_bytes":924,"redis_write_bytes":5844,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.007361,"redis_feature_flag_read_bytes":900,"redis_feature_flag_write_bytes":1173,"redis_queues_calls":2,"redis_queues_duration_s":0.001361,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3279,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.020643,"redis_queues_metadata_read_bytes":16,"redis_queues_metadata_write_bytes":786,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.005831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":606,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04482846,"extra.container_expiration_policy_worker.cleanup_required_count":0,"extra.container_expiration_policy_worker.cleanup_unfinished_count":0,"extra.container_expiration_policy_worker.cleanup_total_count":0,"duration_s":0.273329,"completed_at":"2026-10-10T10:50:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.090272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 328.799072] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"46675e517195acd404897018","created_at":"2026-10-10T10:50:05.348Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d903458d94a8289f3c55070a146d8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.354Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-46675e517195acd404897018: start","job_status":"start","queue_duration_s":0.250513,"scheduling_latency_s":0.250562}1508gitlab # [ 329.023535] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"46675e517195acd404897018","created_at":"2026-10-10T10:50:05.348Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d903458d94a8289f3c55070a146d8f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.354Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-46675e517195acd404897018: done: 0.283914 sec","job_status":"done","queue_duration_s":0.250513,"scheduling_latency_s":0.250562,"redis_calls":11,"redis_duration_s":0.059033,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002119,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.050624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.082,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00418412,"exclusive_lock_hold_duration_s":0.16799478,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.283914,"completed_at":"2026-10-10T10:50:05.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.165818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 329.097134] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8e2fe17b35509bc5d3b9ccc8","created_at":"2026-10-10T10:50:05.380Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d653f3c697e8c3f92d452b42ad593ac9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.385Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8e2fe17b35509bc5d3b9ccc8: start","job_status":"start","queue_duration_s":0.507301,"scheduling_latency_s":0.50735}1510gitlab # [ 329.115255] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8e2fe17b35509bc5d3b9ccc8","created_at":"2026-10-10T10:50:05.380Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d653f3c697e8c3f92d452b42ad593ac9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.385Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8e2fe17b35509bc5d3b9ccc8: done: 0.075899 sec","job_status":"done","queue_duration_s":0.507301,"scheduling_latency_s":0.50735,"redis_calls":10,"redis_duration_s":0.003408,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00114762,"exclusive_lock_hold_duration_s":0.01961762,"duration_s":0.075899,"completed_at":"2026-10-10T10:50:05.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 329.162705] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:05.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c8a1652b03f4f5e94af50052","created_at":"2026-10-10T10:50:05.391Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af6d9aa98226086e44cc3aa65e2ff085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.397Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c8a1652b03f4f5e94af50052: start","job_status":"start","queue_duration_s":0.575225,"scheduling_latency_s":0.575274}1512gitlab # [ 329.178842] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c8a1652b03f4f5e94af50052","created_at":"2026-10-10T10:50:05.391Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af6d9aa98226086e44cc3aa65e2ff085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.397Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c8a1652b03f4f5e94af50052: done: 0.036403 sec","job_status":"done","queue_duration_s":0.575225,"scheduling_latency_s":0.575274,"redis_calls":10,"redis_duration_s":0.002829,"redis_read_bytes":389,"redis_write_bytes":1078,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036403,"completed_at":"2026-10-10T10:50:06.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 329.227461] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2a5db4018e52e3dd6fd7a2c0","created_at":"2026-10-10T10:50:05.421Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.440Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2a5db4018e52e3dd6fd7a2c0: start","job_status":"start","queue_duration_s":0.570831,"scheduling_latency_s":0.570864}1514gitlab # [ 329.244409] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2a5db4018e52e3dd6fd7a2c0","created_at":"2026-10-10T10:50:05.421Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.440Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2a5db4018e52e3dd6fd7a2c0: done: 0.082576 sec","job_status":"done","queue_duration_s":0.570831,"scheduling_latency_s":0.570864,"redis_calls":16,"redis_duration_s":0.00463,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000471,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00277,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082576,"completed_at":"2026-10-10T10:50:06.093Z","load_balancing_strategy":"primary","db_duration_s":0.00966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 329.292900] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c8b0549e638faf6fc44574c3","created_at":"2026-10-10T10:50:05.455Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a92c6b53a44196ab504fb6cf94dad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:50:05.460Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c8b0549e638faf6fc44574c3: start","job_status":"start","queue_duration_s":0.636478,"scheduling_latency_s":0.636523}1516gitlab # [ 329.307306] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.125Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1517gitlab # [ 329.311436] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c8b0549e638faf6fc44574c3","created_at":"2026-10-10T10:50:05.455Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a92c6b53a44196ab504fb6cf94dad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:50:05.460Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c8b0549e638faf6fc44574c3: done: 0.04869 sec","job_status":"done","queue_duration_s":0.636478,"scheduling_latency_s":0.636523,"redis_calls":8,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04869,"completed_at":"2026-10-10T10:50:06.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 329.355592] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e635ebf6dd148b3406e8727","created_at":"2026-10-10T10:50:05.482Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.492Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e635ebf6dd148b3406e8727: start","job_status":"start","queue_duration_s":0.656547,"scheduling_latency_s":0.65659}1519gitlab # [ 329.705159] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e635ebf6dd148b3406e8727","created_at":"2026-10-10T10:50:05.482Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.492Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e635ebf6dd148b3406e8727: done: 0.421804 sec","job_status":"done","queue_duration_s":0.656547,"scheduling_latency_s":0.65659,"redis_calls":65,"redis_duration_s":0.12629100000000001,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001027,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.0011,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.123365,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.421804,"completed_at":"2026-10-10T10:50:06.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 329.773425] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1dc38a5540057ff263d67f0c","created_at":"2026-10-10T10:50:05.511Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5bb45414413d9ca9e03bfb9b9d7864","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.522Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1dc38a5540057ff263d67f0c: start","job_status":"start","queue_duration_s":1.050435,"scheduling_latency_s":1.050469}1521gitlab # [ 329.791727] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.588Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1522gitlab # [ 329.796086] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1dc38a5540057ff263d67f0c","created_at":"2026-10-10T10:50:05.511Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a5bb45414413d9ca9e03bfb9b9d7864","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.522Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1dc38a5540057ff263d67f0c: done: 0.024695 sec","job_status":"done","queue_duration_s":1.050435,"scheduling_latency_s":1.050469,"redis_calls":8,"redis_duration_s":0.002091,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000228,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024695,"completed_at":"2026-10-10T10:50:06.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 329.843034] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f4359726f5aec638e556f1ed","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f4359726f5aec638e556f1ed: start","job_status":"start","queue_duration_s":1.062557,"scheduling_latency_s":1.062587}1524gitlab # [ 329.858715] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f4359726f5aec638e556f1ed","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f4359726f5aec638e556f1ed: done: 0.071053 sec","job_status":"done","queue_duration_s":1.062557,"scheduling_latency_s":1.062587,"redis_calls":13,"redis_duration_s":0.005204,"redis_read_bytes":12,"redis_write_bytes":1785,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":365,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":559,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":861,"db_count":5,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044288,"duration_s":0.071053,"completed_at":"2026-10-10T10:50:06.670Z","load_balancing_strategy":"primary","db_duration_s":0.010073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 329.903240] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"81bc561fbb47eeb1b1db54d6","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-81bc561fbb47eeb1b1db54d6: start","job_status":"start","queue_duration_s":1.13563,"scheduling_latency_s":1.13566}1526gitlab # [ 329.917662] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"81bc561fbb47eeb1b1db54d6","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-81bc561fbb47eeb1b1db54d6: done: 0.047823 sec","job_status":"done","queue_duration_s":1.13563,"scheduling_latency_s":1.13566,"redis_calls":10,"redis_duration_s":0.002703,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001621,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047823,"completed_at":"2026-10-10T10:50:06.720Z","load_balancing_strategy":"primary","db_duration_s":0.004882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 329.959865] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"b8ee3eb617a3690346c2f4fa","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-b8ee3eb617a3690346c2f4fa: start","job_status":"start","queue_duration_s":1.185375,"scheduling_latency_s":1.185406}1528gitlab # [ 329.974465] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"b8ee3eb617a3690346c2f4fa","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-b8ee3eb617a3690346c2f4fa: done: 0.039945 sec","job_status":"done","queue_duration_s":1.185375,"scheduling_latency_s":1.185406,"redis_calls":10,"redis_duration_s":0.002507,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001438,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039945,"completed_at":"2026-10-10T10:50:06.762Z","load_balancing_strategy":"primary","db_duration_s":0.00428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 330.017165] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"e32a8371adad89fb57f3c060","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-e32a8371adad89fb57f3c060: start","job_status":"start","queue_duration_s":1.227483,"scheduling_latency_s":1.227507}1530gitlab # [ 330.031460] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"e32a8371adad89fb57f3c060","created_at":"2026-10-10T10:50:05.498Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-57b20b8cec8a4e87","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b9648dbc32e193ba5ac645f4b4b83e99","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-e32a8371adad89fb57f3c060: done: 0.035119 sec","job_status":"done","queue_duration_s":1.227483,"scheduling_latency_s":1.227507,"redis_calls":10,"redis_duration_s":0.002316,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035119,"completed_at":"2026-10-10T10:50:06.799Z","load_balancing_strategy":"primary","db_duration_s":0.004308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 330.074818] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3f9bffdffe7b179b8dafc941","created_at":"2026-10-10T10:50:05.538Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ca5919981749a30a06223f167aa3658","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.550Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3f9bffdffe7b179b8dafc941: start","job_status":"start","queue_duration_s":1.250806,"scheduling_latency_s":1.25083}1532gitlab # [ 330.090327] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3f9bffdffe7b179b8dafc941","created_at":"2026-10-10T10:50:05.538Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ca5919981749a30a06223f167aa3658","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.550Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3f9bffdffe7b179b8dafc941: done: 0.016413 sec","job_status":"done","queue_duration_s":1.250806,"scheduling_latency_s":1.25083,"redis_calls":8,"redis_duration_s":0.001604,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000191,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016413,"completed_at":"2026-10-10T10:50:06.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 330.135404] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"8789de97b290ae277ff31faf","created_at":"2026-10-10T10:50:05.568Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b1f49db359407ba623e1cf5a1820b4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.587Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-8789de97b290ae277ff31faf: start","job_status":"start","queue_duration_s":1.231824,"scheduling_latency_s":1.231848}1534gitlab # [ 330.149704] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"8789de97b290ae277ff31faf","created_at":"2026-10-10T10:50:05.568Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b1f49db359407ba623e1cf5a1820b4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.587Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-8789de97b290ae277ff31faf: done: 0.033148 sec","job_status":"done","queue_duration_s":1.231824,"scheduling_latency_s":1.231848,"redis_calls":10,"redis_duration_s":0.002894,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062802,"duration_s":0.033148,"completed_at":"2026-10-10T10:50:06.852Z","load_balancing_strategy":"primary","db_duration_s":0.001991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 330.193494] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"36c9bd20cd62169ee768a726","created_at":"2026-10-10T10:50:05.603Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0be1bd631e3a5e0e9eaf3676db2bfca5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.612Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-36c9bd20cd62169ee768a726: start","job_status":"start","queue_duration_s":1.242076,"scheduling_latency_s":1.242106}1536gitlab # [ 330.208711] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.869Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1537gitlab # [ 330.212490] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"36c9bd20cd62169ee768a726","created_at":"2026-10-10T10:50:05.603Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0be1bd631e3a5e0e9eaf3676db2bfca5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.612Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-36c9bd20cd62169ee768a726: done: 0.024505 sec","job_status":"done","queue_duration_s":1.242076,"scheduling_latency_s":1.242106,"redis_calls":8,"redis_duration_s":0.002206,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024505,"completed_at":"2026-10-10T10:50:06.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 330.257213] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5388d434e186945f06688151","created_at":"2026-10-10T10:50:05.644Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3a022e11bfe2920a973e5a459d6573e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.656Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5388d434e186945f06688151: start","job_status":"start","queue_duration_s":1.225368,"scheduling_latency_s":1.225404}1539gitlab # [ 330.273590] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5388d434e186945f06688151","created_at":"2026-10-10T10:50:05.644Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3a022e11bfe2920a973e5a459d6573e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.656Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5388d434e186945f06688151: done: 0.029224 sec","job_status":"done","queue_duration_s":1.225368,"scheduling_latency_s":1.225404,"redis_calls":10,"redis_duration_s":0.002909,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.0002,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00084084,"exclusive_lock_hold_duration_s":0.0050937,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.029224,"completed_at":"2026-10-10T10:50:06.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 330.319755] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"3bb8ef971ea8235fd3171ce1","created_at":"2026-10-10T10:50:05.673Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adb79cd8751345b096e0e6844ef33181","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.688Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-3bb8ef971ea8235fd3171ce1: start","job_status":"start","queue_duration_s":1.225569,"scheduling_latency_s":1.225605}1541gitlab # [ 330.338560] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"3bb8ef971ea8235fd3171ce1","created_at":"2026-10-10T10:50:05.673Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adb79cd8751345b096e0e6844ef33181","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.688Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-3bb8ef971ea8235fd3171ce1: done: 0.030571 sec","job_status":"done","queue_duration_s":1.225569,"scheduling_latency_s":1.225605,"redis_calls":10,"redis_duration_s":0.001999,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030244,"duration_s":0.030571,"completed_at":"2026-10-10T10:50:06.944Z","load_balancing_strategy":"primary","db_duration_s":0.000659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 330.383361] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a1188711e8b418f38cbd8831","created_at":"2026-10-10T10:50:05.696Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a38e73c6bac666ff97fa3ffdca0e31","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.703Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a1188711e8b418f38cbd8831: start","job_status":"start","queue_duration_s":1.242138,"scheduling_latency_s":1.242158}1543gitlab # [ 330.398504] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a1188711e8b418f38cbd8831","created_at":"2026-10-10T10:50:05.696Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a38e73c6bac666ff97fa3ffdca0e31","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.703Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a1188711e8b418f38cbd8831: done: 0.018434 sec","job_status":"done","queue_duration_s":1.242138,"scheduling_latency_s":1.242158,"redis_calls":8,"redis_duration_s":0.00165,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000166,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018434,"completed_at":"2026-10-10T10:50:06.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 330.443761] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:06.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a948b1fc7330618e8b4197be","created_at":"2026-10-10T10:50:05.713Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec139630d5e9cb83b554b51fc43a4a44","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.718Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a948b1fc7330618e8b4197be: start","job_status":"start","queue_duration_s":1.246861,"scheduling_latency_s":1.246882}1545gitlab # [ 330.464722] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a948b1fc7330618e8b4197be","created_at":"2026-10-10T10:50:05.713Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec139630d5e9cb83b554b51fc43a4a44","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.718Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a948b1fc7330618e8b4197be: done: 0.365305 sec","job_status":"done","queue_duration_s":1.246861,"scheduling_latency_s":1.246882,"redis_calls":563,"redis_duration_s":0.07531299999999999,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.073361,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.331289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.365305,"completed_at":"2026-10-10T10:50:07.331Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 330.509975] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.332Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6560a1d2305dcc08927bfae9","created_at":"2026-10-10T10:50:05.727Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"713030e1896bd9f69ff5a74b1974c82f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:50:05.733Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6560a1d2305dcc08927bfae9: start","job_status":"start","queue_duration_s":1.599153,"scheduling_latency_s":1.599184}1547gitlab # [ 330.524086] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6560a1d2305dcc08927bfae9","created_at":"2026-10-10T10:50:05.727Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"713030e1896bd9f69ff5a74b1974c82f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:50:05.733Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6560a1d2305dcc08927bfae9: done: 0.028312 sec","job_status":"done","queue_duration_s":1.599153,"scheduling_latency_s":1.599184,"redis_calls":8,"redis_duration_s":0.0015910000000000002,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000144,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028312,"completed_at":"2026-10-10T10:50:07.360Z","load_balancing_strategy":"primary","db_duration_s":0.002775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 330.567617] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e0716bf2a33e5af4ac7184a9","created_at":"2026-10-10T10:50:05.746Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"befe44a069477727e43524e0e0231417","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.756Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e0716bf2a33e5af4ac7184a9: start","job_status":"start","queue_duration_s":1.606688,"scheduling_latency_s":1.606715}1549gitlab # [ 330.583224] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.372Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1550gitlab # [ 330.587459] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e0716bf2a33e5af4ac7184a9","created_at":"2026-10-10T10:50:05.746Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"befe44a069477727e43524e0e0231417","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.756Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e0716bf2a33e5af4ac7184a9: done: 0.016668 sec","job_status":"done","queue_duration_s":1.606688,"scheduling_latency_s":1.606715,"redis_calls":8,"redis_duration_s":0.001392,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000169,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016668,"completed_at":"2026-10-10T10:50:07.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 330.633009] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c16a3bfe09616db480f129e9","created_at":"2026-10-10T10:50:05.763Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9265367f4f669a77f11e0c855e9467e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.769Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c16a3bfe09616db480f129e9: start","job_status":"start","queue_duration_s":1.61128,"scheduling_latency_s":1.611303}1552gitlab # [ 330.648374] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.390Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1553gitlab # [ 330.651727] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c16a3bfe09616db480f129e9","created_at":"2026-10-10T10:50:05.763Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9265367f4f669a77f11e0c855e9467e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.769Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c16a3bfe09616db480f129e9: done: 0.016005 sec","job_status":"done","queue_duration_s":1.61128,"scheduling_latency_s":1.611303,"redis_calls":8,"redis_duration_s":0.0014140000000000001,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000138,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016005,"completed_at":"2026-10-10T10:50:07.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 330.699512] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.398Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"074c9e6a0bbabafc988077cd","created_at":"2026-10-10T10:50:05.806Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee9f1d6371cc275395f5bf6e04b7428d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.814Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-074c9e6a0bbabafc988077cd: start","job_status":"start","queue_duration_s":1.584169,"scheduling_latency_s":1.584193}1555gitlab # [ 330.714624] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.415Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"074c9e6a0bbabafc988077cd","created_at":"2026-10-10T10:50:05.806Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee9f1d6371cc275395f5bf6e04b7428d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.814Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-074c9e6a0bbabafc988077cd: done: 0.016882 sec","job_status":"done","queue_duration_s":1.584169,"scheduling_latency_s":1.584193,"redis_calls":11,"redis_duration_s":0.001841,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000394,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000143,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016882,"completed_at":"2026-10-10T10:50:07.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 330.761350] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d6bbbb5bdf6b0939af52f1ad","created_at":"2026-10-10T10:50:05.871Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c790d39d093cf3b14b9cbdd89b41c664","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.884Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d6bbbb5bdf6b0939af52f1ad: start","job_status":"start","queue_duration_s":1.532674,"scheduling_latency_s":1.532697}1557gitlab # [ 330.777181] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d6bbbb5bdf6b0939af52f1ad","created_at":"2026-10-10T10:50:05.871Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c790d39d093cf3b14b9cbdd89b41c664","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.884Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d6bbbb5bdf6b0939af52f1ad: done: 0.027871 sec","job_status":"done","queue_duration_s":1.532674,"scheduling_latency_s":1.532697,"redis_calls":11,"redis_duration_s":0.002085,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000159,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00722288,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.027871,"completed_at":"2026-10-10T10:50:07.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003282,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1558gitlab # [ 330.827072] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"38f7c83c665b771ea9b08e45","created_at":"2026-10-10T10:50:05.902Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cf9b89cf912c4c9df34a2b16cdc5a9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.937Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-38f7c83c665b771ea9b08e45: start","job_status":"start","queue_duration_s":1.508523,"scheduling_latency_s":1.508547}1559gitlab # [ 330.842481] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"38f7c83c665b771ea9b08e45","created_at":"2026-10-10T10:50:05.902Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cf9b89cf912c4c9df34a2b16cdc5a9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:05.937Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-38f7c83c665b771ea9b08e45: done: 0.058352 sec","job_status":"done","queue_duration_s":1.508523,"scheduling_latency_s":1.508547,"redis_calls":10,"redis_duration_s":0.0018650000000000001,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031172,"duration_s":0.058352,"completed_at":"2026-10-10T10:50:07.504Z","load_balancing_strategy":"primary","db_duration_s":0.017829,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 330.891072] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"84dddc1027b91d8354112ca3","created_at":"2026-10-10T10:50:05.947Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfd57896f063f36719057d6a08b57f18","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.006Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-84dddc1027b91d8354112ca3: start","job_status":"start","queue_duration_s":1.500094,"scheduling_latency_s":1.500122}1561gitlab # [ 330.905735] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"84dddc1027b91d8354112ca3","created_at":"2026-10-10T10:50:05.947Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfd57896f063f36719057d6a08b57f18","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.006Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-84dddc1027b91d8354112ca3: done: 0.027856 sec","job_status":"done","queue_duration_s":1.500094,"scheduling_latency_s":1.500122,"redis_calls":10,"redis_duration_s":0.002075,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031878,"duration_s":0.027856,"completed_at":"2026-10-10T10:50:07.534Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 330.951413] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.535Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a4fe75e95460e911880e2c08","created_at":"2026-10-10T10:50:06.035Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8238ef7819e33c490e7c9cec5616c941","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.043Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a4fe75e95460e911880e2c08: start","job_status":"start","queue_duration_s":1.492692,"scheduling_latency_s":1.49272}1563gitlab # [ 330.967145] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a4fe75e95460e911880e2c08","created_at":"2026-10-10T10:50:06.035Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8238ef7819e33c490e7c9cec5616c941","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.043Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a4fe75e95460e911880e2c08: done: 0.056396 sec","job_status":"done","queue_duration_s":1.492692,"scheduling_latency_s":1.49272,"redis_calls":11,"redis_duration_s":0.002164,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000753,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056396,"completed_at":"2026-10-10T10:50:07.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 331.011843] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.593Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e6c977fa8d794270a32842d","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e6c977fa8d794270a32842d: start","job_status":"start","queue_duration_s":1.521823,"scheduling_latency_s":1.521853}1565gitlab # [ 331.025076] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.610Z","message":"No existing merge request to be cleaned up."}1566gitlab # [ 331.026814] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.622Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7e6c977fa8d794270a32842d","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7e6c977fa8d794270a32842d: done: 0.028552 sec","job_status":"done","queue_duration_s":1.521823,"scheduling_latency_s":1.521853,"redis_calls":11,"redis_duration_s":0.002262,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000164,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001245,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028552,"completed_at":"2026-10-10T10:50:07.622Z","load_balancing_strategy":"primary","db_duration_s":0.004437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 331.069661] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.624Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e140aac6285d39aa67e02bd5","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e140aac6285d39aa67e02bd5: start","job_status":"start","queue_duration_s":1.552152,"scheduling_latency_s":1.552182}1568gitlab # [ 331.082908] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.637Z","message":"No existing merge request to be cleaned up."}1569gitlab # [ 331.085754] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.649Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e140aac6285d39aa67e02bd5","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e140aac6285d39aa67e02bd5: done: 0.024842 sec","job_status":"done","queue_duration_s":1.552152,"scheduling_latency_s":1.552182,"redis_calls":10,"redis_duration_s":0.003844,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003157,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024842,"completed_at":"2026-10-10T10:50:07.648Z","load_balancing_strategy":"primary","db_duration_s":0.00213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 331.126724] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.650Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4d4f89a80692c6358b68b059","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4d4f89a80692c6358b68b059: start","job_status":"start","queue_duration_s":1.578254,"scheduling_latency_s":1.578278}1571gitlab # [ 331.140072] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.661Z","message":"No existing merge request to be cleaned up."}1572gitlab # [ 331.141882] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.669Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4d4f89a80692c6358b68b059","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4d4f89a80692c6358b68b059: done: 0.019612 sec","job_status":"done","queue_duration_s":1.578254,"scheduling_latency_s":1.578278,"redis_calls":10,"redis_duration_s":0.001414,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019612,"completed_at":"2026-10-10T10:50:07.669Z","load_balancing_strategy":"primary","db_duration_s":0.001701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 331.183034] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.671Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"14c8d72b3bf993cd1ed01f2e","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-14c8d72b3bf993cd1ed01f2e: start","job_status":"start","queue_duration_s":1.599198,"scheduling_latency_s":1.599221}1574gitlab # [ 331.196300] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.682Z","message":"No existing merge request to be cleaned up."}1575gitlab # [ 331.198064] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.690Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"14c8d72b3bf993cd1ed01f2e","created_at":"2026-10-10T10:50:06.041Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-dc6a5cd38fb748d0","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e3e3263a43478d03dbde68d28d230f0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.072Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-14c8d72b3bf993cd1ed01f2e: done: 0.01968 sec","job_status":"done","queue_duration_s":1.599198,"scheduling_latency_s":1.599221,"redis_calls":10,"redis_duration_s":0.001506,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01968,"completed_at":"2026-10-10T10:50:07.690Z","load_balancing_strategy":"primary","db_duration_s":0.001552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 331.239195] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4c2986994875a474c9657233","created_at":"2026-10-10T10:50:06.068Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd43ff6d2f7c70a56ec849843fbc6685","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.089Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4c2986994875a474c9657233: start","job_status":"start","queue_duration_s":1.602504,"scheduling_latency_s":1.602528}1577gitlab # [ 331.254824] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4c2986994875a474c9657233","created_at":"2026-10-10T10:50:06.068Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd43ff6d2f7c70a56ec849843fbc6685","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.089Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4c2986994875a474c9657233: done: 0.019602 sec","job_status":"done","queue_duration_s":1.602504,"scheduling_latency_s":1.602528,"redis_calls":8,"redis_duration_s":0.001423,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000148,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019602,"completed_at":"2026-10-10T10:50:07.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 331.300938] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"519d4ad035cd93603e901bb7","created_at":"2026-10-10T10:50:06.109Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01cf0fae8cd8cde5544da3b78293f8e9","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.188Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-519d4ad035cd93603e901bb7: start","job_status":"start","queue_duration_s":1.524512,"scheduling_latency_s":1.524537}1579gitlab # [ 331.315367] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"519d4ad035cd93603e901bb7","created_at":"2026-10-10T10:50:06.109Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01cf0fae8cd8cde5544da3b78293f8e9","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.188Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-519d4ad035cd93603e901bb7: done: 0.053729 sec","job_status":"done","queue_duration_s":1.524512,"scheduling_latency_s":1.524537,"redis_calls":10,"redis_duration_s":0.0017289999999999999,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00039,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028756,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0035282},"duration_s":0.053729,"completed_at":"2026-10-10T10:50:07.767Z","load_balancing_strategy":"primary","db_duration_s":0.018338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 331.363521] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5ec1ffbb5091f8ef73766b10","created_at":"2026-10-10T10:50:06.211Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f3f31f72f0708ba217c796f7e69b263","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:50:06.221Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5ec1ffbb5091f8ef73766b10: start","job_status":"start","queue_duration_s":1.546795,"scheduling_latency_s":1.54682}1581gitlab # [ 331.379569] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.777Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1582gitlab # [ 331.383916] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5ec1ffbb5091f8ef73766b10","created_at":"2026-10-10T10:50:06.211Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f3f31f72f0708ba217c796f7e69b263","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:50:06.221Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5ec1ffbb5091f8ef73766b10: done: 0.015059 sec","job_status":"done","queue_duration_s":1.546795,"scheduling_latency_s":1.54682,"redis_calls":8,"redis_duration_s":0.001233,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000144,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015059,"completed_at":"2026-10-10T10:50:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 331.431652] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"387db4f44c37aded85961e42","created_at":"2026-10-10T10:50:06.240Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03399db6cb1e62d3bbfd44932fb81db6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.263Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-387db4f44c37aded85961e42: start","job_status":"start","queue_duration_s":1.521752,"scheduling_latency_s":1.521776}1584gitlab # [ 331.447778] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"387db4f44c37aded85961e42","created_at":"2026-10-10T10:50:06.240Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03399db6cb1e62d3bbfd44932fb81db6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.263Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-387db4f44c37aded85961e42: done: 0.022343 sec","job_status":"done","queue_duration_s":1.521752,"scheduling_latency_s":1.521776,"redis_calls":11,"redis_duration_s":0.0018310000000000002,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00028,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026752,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.022343,"completed_at":"2026-10-10T10:50:07.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 331.497512] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"48ba37e978429cff000cdd5b","created_at":"2026-10-10T10:50:06.279Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5221f0b88331c2276ea5e4dba65b499","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.295Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-48ba37e978429cff000cdd5b: start","job_status":"start","queue_duration_s":1.513543,"scheduling_latency_s":1.513569}1586gitlab # [ 331.512784] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"48ba37e978429cff000cdd5b","created_at":"2026-10-10T10:50:06.279Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5221f0b88331c2276ea5e4dba65b499","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.295Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-48ba37e978429cff000cdd5b: done: 0.026356 sec","job_status":"done","queue_duration_s":1.513543,"scheduling_latency_s":1.513569,"redis_calls":8,"redis_duration_s":0.001363,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000146,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.026356,"completed_at":"2026-10-10T10:50:07.835Z","load_balancing_strategy":"primary","db_duration_s":0.009094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 331.561732] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"f72c83c2fd133cf0a6825d5c","created_at":"2026-10-10T10:50:06.312Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82e7e421551722e37264eccd4e5fedc3","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.335Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-f72c83c2fd133cf0a6825d5c: start","job_status":"start","queue_duration_s":1.500853,"scheduling_latency_s":1.500879}1588gitlab # [ 331.578751] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"f72c83c2fd133cf0a6825d5c","created_at":"2026-10-10T10:50:06.312Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82e7e421551722e37264eccd4e5fedc3","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.335Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-f72c83c2fd133cf0a6825d5c: done: 0.028308 sec","job_status":"done","queue_duration_s":1.500853,"scheduling_latency_s":1.500879,"redis_calls":13,"redis_duration_s":0.002356,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025266,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.028308,"completed_at":"2026-10-10T10:50:07.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 331.627554] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ad38dba0d9f9954205203811","created_at":"2026-10-10T10:50:06.369Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a884853a167bc6f4bdf94d303c586ee8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.384Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ad38dba0d9f9954205203811: start","job_status":"start","queue_duration_s":1.481206,"scheduling_latency_s":1.481228}1590gitlab # [ 331.642430] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ad38dba0d9f9954205203811","created_at":"2026-10-10T10:50:06.369Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a884853a167bc6f4bdf94d303c586ee8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.384Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ad38dba0d9f9954205203811: done: 0.018082 sec","job_status":"done","queue_duration_s":1.481206,"scheduling_latency_s":1.481228,"redis_calls":10,"redis_duration_s":0.001479,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051242,"exclusive_lock_hold_duration_s":0.00331824,"duration_s":0.018082,"completed_at":"2026-10-10T10:50:07.884Z","load_balancing_strategy":"primary","db_duration_s":0.00092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 331.688556] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"da9ffc9323457209da06b3d8","created_at":"2026-10-10T10:50:06.409Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.432Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-da9ffc9323457209da06b3d8: start","job_status":"start","queue_duration_s":1.452813,"scheduling_latency_s":1.452836}1592gitlab # [ 331.706148] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.919Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"da9ffc9323457209da06b3d8","created_at":"2026-10-10T10:50:06.409Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.432Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-da9ffc9323457209da06b3d8: done: 0.034065 sec","job_status":"done","queue_duration_s":1.452813,"scheduling_latency_s":1.452836,"redis_calls":20,"redis_duration_s":0.003125,"redis_read_bytes":23,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000938,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000594,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027844,"duration_s":0.034065,"completed_at":"2026-10-10T10:50:07.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 331.757150] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ce2533943e9ec42ae97d091","created_at":"2026-10-10T10:50:06.452Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f2f3df8faa6bf980d846c52264f2c70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.467Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ce2533943e9ec42ae97d091: start","job_status":"start","queue_duration_s":1.45355,"scheduling_latency_s":1.453573}1594gitlab # [ 331.773164] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ce2533943e9ec42ae97d091","created_at":"2026-10-10T10:50:06.452Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f2f3df8faa6bf980d846c52264f2c70","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.467Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ce2533943e9ec42ae97d091: done: 0.039311 sec","job_status":"done","queue_duration_s":1.45355,"scheduling_latency_s":1.453573,"redis_calls":10,"redis_duration_s":0.001678,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000127,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058844,"exclusive_lock_hold_duration_s":0.01663346,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.039311,"completed_at":"2026-10-10T10:50:07.960Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 331.821848] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:07.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3a344997385fad2bd9e923b1","created_at":"2026-10-10T10:50:06.482Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93788cefbb9984baa1038a190955dd5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.493Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3a344997385fad2bd9e923b1: start","job_status":"start","queue_duration_s":1.468467,"scheduling_latency_s":1.468491}1596gitlab # [ 331.836916] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3a344997385fad2bd9e923b1","created_at":"2026-10-10T10:50:06.482Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93788cefbb9984baa1038a190955dd5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.493Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3a344997385fad2bd9e923b1: done: 0.221596 sec","job_status":"done","queue_duration_s":1.468467,"scheduling_latency_s":1.468491,"redis_calls":12,"redis_duration_s":0.0021709999999999998,"redis_read_bytes":137,"redis_write_bytes":1346,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055732,"exclusive_lock_hold_duration_s":0.20165216,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.221596,"completed_at":"2026-10-10T10:50:08.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 331.884041] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"b7cdf8ba845c392714c83e70","created_at":"2026-10-10T10:50:06.517Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3000f65d5d55186d454929722542c45","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-b7cdf8ba845c392714c83e70: start","job_status":"start","queue_duration_s":1.647915,"scheduling_latency_s":1.64794}1598gitlab # [ 331.899289] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"b7cdf8ba845c392714c83e70","created_at":"2026-10-10T10:50:06.517Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-d41bd414c59b4f81","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3000f65d5d55186d454929722542c45","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.536Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-b7cdf8ba845c392714c83e70: done: 0.021079 sec","job_status":"done","queue_duration_s":1.647915,"scheduling_latency_s":1.64794,"redis_calls":10,"redis_duration_s":0.001509,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026388,"duration_s":0.021079,"completed_at":"2026-10-10T10:50:08.205Z","load_balancing_strategy":"primary","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 331.943380] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d2146d4541edcffd9d868b","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d2146d4541edcffd9d868b: start","job_status":"start","queue_duration_s":1.650608,"scheduling_latency_s":1.650632}1600gitlab # [ 331.956647] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d2146d4541edcffd9d868b","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d2146d4541edcffd9d868b: done: 0.017708 sec","job_status":"done","queue_duration_s":1.650608,"scheduling_latency_s":1.650632,"redis_calls":14,"redis_duration_s":0.001937,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000139,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017708,"completed_at":"2026-10-10T10:50:08.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 331.999809] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9486593e59c23d5d7ae2aff4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9486593e59c23d5d7ae2aff4: start","job_status":"start","queue_duration_s":1.669767,"scheduling_latency_s":1.669789}1602gitlab # [ 332.013169] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9486593e59c23d5d7ae2aff4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9486593e59c23d5d7ae2aff4: done: 0.018395 sec","job_status":"done","queue_duration_s":1.669767,"scheduling_latency_s":1.669789,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018395,"completed_at":"2026-10-10T10:50:08.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 332.054639] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddadff718ec229f1e62d22e4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddadff718ec229f1e62d22e4: start","job_status":"start","queue_duration_s":1.689564,"scheduling_latency_s":1.689587}1604gitlab # [ 332.067913] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddadff718ec229f1e62d22e4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddadff718ec229f1e62d22e4: done: 0.01761 sec","job_status":"done","queue_duration_s":1.689564,"scheduling_latency_s":1.689587,"redis_calls":13,"redis_duration_s":0.001981,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01761,"completed_at":"2026-10-10T10:50:08.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 332.110506] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb0409f7b159ac5dc0743e61","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb0409f7b159ac5dc0743e61: start","job_status":"start","queue_duration_s":1.708554,"scheduling_latency_s":1.708577}1606gitlab # [ 332.123594] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb0409f7b159ac5dc0743e61","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb0409f7b159ac5dc0743e61: done: 0.016832 sec","job_status":"done","queue_duration_s":1.708554,"scheduling_latency_s":1.708577,"redis_calls":13,"redis_duration_s":0.001912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016832,"completed_at":"2026-10-10T10:50:08.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 332.165520] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46391e606fd111668353f0a0","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46391e606fd111668353f0a0: start","job_status":"start","queue_duration_s":1.726897,"scheduling_latency_s":1.72692}1608gitlab # [ 332.178650] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46391e606fd111668353f0a0","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46391e606fd111668353f0a0: done: 0.016507 sec","job_status":"done","queue_duration_s":1.726897,"scheduling_latency_s":1.72692,"redis_calls":13,"redis_duration_s":0.001716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016507,"completed_at":"2026-10-10T10:50:08.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 332.220531] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b27b29e649bcfefb2f5fd027","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b27b29e649bcfefb2f5fd027: start","job_status":"start","queue_duration_s":1.744706,"scheduling_latency_s":1.744728}1610gitlab # [ 332.233604] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b27b29e649bcfefb2f5fd027","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b27b29e649bcfefb2f5fd027: done: 0.016076 sec","job_status":"done","queue_duration_s":1.744706,"scheduling_latency_s":1.744728,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016076,"completed_at":"2026-10-10T10:50:08.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 332.276070] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e447f17a55ffb59bca94eae","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e447f17a55ffb59bca94eae: start","job_status":"start","queue_duration_s":1.762107,"scheduling_latency_s":1.762129}1612gitlab # [ 332.293508] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e447f17a55ffb59bca94eae","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e447f17a55ffb59bca94eae: done: 0.028036 sec","job_status":"done","queue_duration_s":1.762107,"scheduling_latency_s":1.762129,"redis_calls":13,"redis_duration_s":0.001875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028036,"completed_at":"2026-10-10T10:50:08.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 332.336261] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ecfe7cf326a8208ab9240a4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ecfe7cf326a8208ab9240a4: start","job_status":"start","queue_duration_s":1.795171,"scheduling_latency_s":1.795203}1614gitlab # [ 332.350590] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ecfe7cf326a8208ab9240a4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ecfe7cf326a8208ab9240a4: done: 0.023422 sec","job_status":"done","queue_duration_s":1.795171,"scheduling_latency_s":1.795203,"redis_calls":13,"redis_duration_s":0.002326,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023422,"completed_at":"2026-10-10T10:50:08.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 332.394422] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"112a59dd9a0c0d7a7fa1e13c","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-112a59dd9a0c0d7a7fa1e13c: start","job_status":"start","queue_duration_s":1.820417,"scheduling_latency_s":1.820447}1616gitlab # [ 332.408333] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"112a59dd9a0c0d7a7fa1e13c","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-112a59dd9a0c0d7a7fa1e13c: done: 0.023869 sec","job_status":"done","queue_duration_s":1.820417,"scheduling_latency_s":1.820447,"redis_calls":13,"redis_duration_s":0.002614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023869,"completed_at":"2026-10-10T10:50:08.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 332.449691] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def09f65afad5f26a46a7645","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def09f65afad5f26a46a7645: start","job_status":"start","queue_duration_s":1.846151,"scheduling_latency_s":1.846182}1618gitlab # [ 332.462876] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def09f65afad5f26a46a7645","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def09f65afad5f26a46a7645: done: 0.023796 sec","job_status":"done","queue_duration_s":1.846151,"scheduling_latency_s":1.846182,"redis_calls":13,"redis_duration_s":0.002778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023796,"completed_at":"2026-10-10T10:50:08.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 332.504912] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8247a4529131028904ad8559","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8247a4529131028904ad8559: start","job_status":"start","queue_duration_s":1.871895,"scheduling_latency_s":1.871929}1620gitlab # [ 332.519112] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8247a4529131028904ad8559","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8247a4529131028904ad8559: done: 0.030866 sec","job_status":"done","queue_duration_s":1.871895,"scheduling_latency_s":1.871929,"redis_calls":13,"redis_duration_s":0.003888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002638,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030866,"completed_at":"2026-10-10T10:50:08.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 332.561060] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cc3a1f6eb26ac56654ddd7d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cc3a1f6eb26ac56654ddd7d: start","job_status":"start","queue_duration_s":1.905243,"scheduling_latency_s":1.905289}1622gitlab # [ 332.574126] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cc3a1f6eb26ac56654ddd7d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cc3a1f6eb26ac56654ddd7d: done: 0.028461 sec","job_status":"done","queue_duration_s":1.905243,"scheduling_latency_s":1.905289,"redis_calls":13,"redis_duration_s":0.0031080000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028461,"completed_at":"2026-10-10T10:50:08.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 332.615662] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e0e1c5dff64d8b8320fb07d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e0e1c5dff64d8b8320fb07d: start","job_status":"start","queue_duration_s":1.935769,"scheduling_latency_s":1.935809}1624gitlab # [ 332.628995] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e0e1c5dff64d8b8320fb07d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e0e1c5dff64d8b8320fb07d: done: 0.023588 sec","job_status":"done","queue_duration_s":1.935769,"scheduling_latency_s":1.935809,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023588,"completed_at":"2026-10-10T10:50:08.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 332.670263] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c02430fc28949810987274","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c02430fc28949810987274: start","job_status":"start","queue_duration_s":1.960816,"scheduling_latency_s":1.960841}1626gitlab # [ 332.683521] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c02430fc28949810987274","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c02430fc28949810987274: done: 0.015177 sec","job_status":"done","queue_duration_s":1.960816,"scheduling_latency_s":1.960841,"redis_calls":13,"redis_duration_s":0.001932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015177,"completed_at":"2026-10-10T10:50:08.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 332.726269] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99f95e966e3245cada484e4d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99f95e966e3245cada484e4d: start","job_status":"start","queue_duration_s":1.977166,"scheduling_latency_s":1.977183}1628gitlab # [ 332.739378] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99f95e966e3245cada484e4d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99f95e966e3245cada484e4d: done: 0.015937 sec","job_status":"done","queue_duration_s":1.977166,"scheduling_latency_s":1.977183,"redis_calls":13,"redis_duration_s":0.002577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015937,"completed_at":"2026-10-10T10:50:08.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 332.781668] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d72eb05aa5c947e0e5ebd738","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d72eb05aa5c947e0e5ebd738: start","job_status":"start","queue_duration_s":1.994553,"scheduling_latency_s":1.994572}1630gitlab # [ 332.795853] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d72eb05aa5c947e0e5ebd738","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d72eb05aa5c947e0e5ebd738: done: 0.016063 sec","job_status":"done","queue_duration_s":1.994553,"scheduling_latency_s":1.994572,"redis_calls":13,"redis_duration_s":0.002317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016063,"completed_at":"2026-10-10T10:50:08.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 332.839405] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9ea129bbb359eb29f2ff29","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9ea129bbb359eb29f2ff29: start","job_status":"start","queue_duration_s":2.012025,"scheduling_latency_s":2.012044}1632gitlab # [ 332.853320] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9ea129bbb359eb29f2ff29","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9ea129bbb359eb29f2ff29: done: 0.016121 sec","job_status":"done","queue_duration_s":2.012025,"scheduling_latency_s":2.012044,"redis_calls":13,"redis_duration_s":0.002179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016121,"completed_at":"2026-10-10T10:50:08.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 332.895475] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bee86ebcd2833101bb1078b","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bee86ebcd2833101bb1078b: start","job_status":"start","queue_duration_s":2.02952,"scheduling_latency_s":2.029537}1634gitlab # [ 332.909449] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bee86ebcd2833101bb1078b","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bee86ebcd2833101bb1078b: done: 0.016152 sec","job_status":"done","queue_duration_s":2.02952,"scheduling_latency_s":2.029537,"redis_calls":13,"redis_duration_s":0.00228,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016152,"completed_at":"2026-10-10T10:50:08.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 332.951906] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13607c810f1646c20515b528","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13607c810f1646c20515b528: start","job_status":"start","queue_duration_s":2.047073,"scheduling_latency_s":2.047168}1636gitlab # [ 332.965232] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13607c810f1646c20515b528","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13607c810f1646c20515b528: done: 0.016828 sec","job_status":"done","queue_duration_s":2.047073,"scheduling_latency_s":2.047168,"redis_calls":13,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016828,"completed_at":"2026-10-10T10:50:08.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 333.006645] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685b908f84ae85e606afd6f3","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685b908f84ae85e606afd6f3: start","job_status":"start","queue_duration_s":2.065303,"scheduling_latency_s":2.065321}1638gitlab # [ 333.019823] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685b908f84ae85e606afd6f3","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685b908f84ae85e606afd6f3: done: 0.015738 sec","job_status":"done","queue_duration_s":2.065303,"scheduling_latency_s":2.065321,"redis_calls":13,"redis_duration_s":0.00217,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001437,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015738,"completed_at":"2026-10-10T10:50:08.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 333.061670] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4f525697f879dcc3959093","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4f525697f879dcc3959093: start","job_status":"start","queue_duration_s":2.082346,"scheduling_latency_s":2.082364}1640gitlab # [ 333.074837] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4f525697f879dcc3959093","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4f525697f879dcc3959093: done: 0.015838 sec","job_status":"done","queue_duration_s":2.082346,"scheduling_latency_s":2.082364,"redis_calls":13,"redis_duration_s":0.002216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015838,"completed_at":"2026-10-10T10:50:08.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 333.116291] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446a6daf24c3299a21c4e356","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446a6daf24c3299a21c4e356: start","job_status":"start","queue_duration_s":2.099552,"scheduling_latency_s":2.09957}1642gitlab # [ 333.130358] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446a6daf24c3299a21c4e356","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446a6daf24c3299a21c4e356: done: 0.015979 sec","job_status":"done","queue_duration_s":2.099552,"scheduling_latency_s":2.09957,"redis_calls":13,"redis_duration_s":0.002176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015979,"completed_at":"2026-10-10T10:50:08.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 333.172258] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a53a1bc42fa398fedb3d578e","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a53a1bc42fa398fedb3d578e: start","job_status":"start","queue_duration_s":2.116879,"scheduling_latency_s":2.116897}1644gitlab # [ 333.185362] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a53a1bc42fa398fedb3d578e","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a53a1bc42fa398fedb3d578e: done: 0.015514 sec","job_status":"done","queue_duration_s":2.116879,"scheduling_latency_s":2.116897,"redis_calls":13,"redis_duration_s":0.002078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015514,"completed_at":"2026-10-10T10:50:08.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 333.226744] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a4a77d3a5217846d165c873","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a4a77d3a5217846d165c873: start","job_status":"start","queue_duration_s":2.133714,"scheduling_latency_s":2.13373}1646gitlab # [ 333.239900] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a4a77d3a5217846d165c873","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a4a77d3a5217846d165c873: done: 0.014554 sec","job_status":"done","queue_duration_s":2.133714,"scheduling_latency_s":2.13373,"redis_calls":13,"redis_duration_s":0.001959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014554,"completed_at":"2026-10-10T10:50:08.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 333.281871] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb626d9b460d1fd878907976","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb626d9b460d1fd878907976: start","job_status":"start","queue_duration_s":2.149458,"scheduling_latency_s":2.149474}1648gitlab # [ 333.295295] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb626d9b460d1fd878907976","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb626d9b460d1fd878907976: done: 0.014688 sec","job_status":"done","queue_duration_s":2.149458,"scheduling_latency_s":2.149474,"redis_calls":13,"redis_duration_s":0.001982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014688,"completed_at":"2026-10-10T10:50:08.720Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 333.340258] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d15669e891367f1dec7740","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d15669e891367f1dec7740: start","job_status":"start","queue_duration_s":2.165392,"scheduling_latency_s":2.165408}1650gitlab # [ 333.354558] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d15669e891367f1dec7740","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d15669e891367f1dec7740: done: 0.014824 sec","job_status":"done","queue_duration_s":2.165392,"scheduling_latency_s":2.165408,"redis_calls":13,"redis_duration_s":0.002044,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001341,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014824,"completed_at":"2026-10-10T10:50:08.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 333.399594] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1775d20eb66392aa4ee9796","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1775d20eb66392aa4ee9796: start","job_status":"start","queue_duration_s":2.181476,"scheduling_latency_s":2.181494}1652gitlab # [ 333.413145] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1775d20eb66392aa4ee9796","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1775d20eb66392aa4ee9796: done: 0.015578 sec","job_status":"done","queue_duration_s":2.181476,"scheduling_latency_s":2.181494,"redis_calls":13,"redis_duration_s":0.002447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015578,"completed_at":"2026-10-10T10:50:08.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 333.455443] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b5ad92e66a158d0a0bd9db","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b5ad92e66a158d0a0bd9db: start","job_status":"start","queue_duration_s":2.198373,"scheduling_latency_s":2.198391}1654gitlab # [ 333.470012] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b5ad92e66a158d0a0bd9db","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b5ad92e66a158d0a0bd9db: done: 0.015877 sec","job_status":"done","queue_duration_s":2.198373,"scheduling_latency_s":2.198391,"redis_calls":13,"redis_duration_s":0.002262,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001486,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015877,"completed_at":"2026-10-10T10:50:08.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 333.515036] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"283aec4c51c657b170d52e0e","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-283aec4c51c657b170d52e0e: start","job_status":"start","queue_duration_s":2.215672,"scheduling_latency_s":2.21569}1656gitlab # [ 333.530247] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"283aec4c51c657b170d52e0e","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-283aec4c51c657b170d52e0e: done: 0.015309 sec","job_status":"done","queue_duration_s":2.215672,"scheduling_latency_s":2.21569,"redis_calls":13,"redis_duration_s":0.002077,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015309,"completed_at":"2026-10-10T10:50:08.787Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 333.572696] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cdb1de9c3de49f707f6edcb","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cdb1de9c3de49f707f6edcb: start","job_status":"start","queue_duration_s":2.232232,"scheduling_latency_s":2.232251}1658gitlab # [ 333.586751] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cdb1de9c3de49f707f6edcb","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cdb1de9c3de49f707f6edcb: done: 0.045627 sec","job_status":"done","queue_duration_s":2.232232,"scheduling_latency_s":2.232251,"redis_calls":13,"redis_duration_s":0.002097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045627,"completed_at":"2026-10-10T10:50:08.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 333.631417] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f33fe942087961fb82bc63d9","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f33fe942087961fb82bc63d9: start","job_status":"start","queue_duration_s":2.279286,"scheduling_latency_s":2.279304}1660gitlab # [ 333.644804] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f33fe942087961fb82bc63d9","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f33fe942087961fb82bc63d9: done: 0.019392 sec","job_status":"done","queue_duration_s":2.279286,"scheduling_latency_s":2.279304,"redis_calls":13,"redis_duration_s":0.0029639999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019392,"completed_at":"2026-10-10T10:50:08.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 333.686425] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16e896c2c5dcb2c075c62f13","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16e896c2c5dcb2c075c62f13: start","job_status":"start","queue_duration_s":2.299999,"scheduling_latency_s":2.300016}1662gitlab # [ 333.699712] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16e896c2c5dcb2c075c62f13","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16e896c2c5dcb2c075c62f13: done: 0.015276 sec","job_status":"done","queue_duration_s":2.299999,"scheduling_latency_s":2.300016,"redis_calls":13,"redis_duration_s":0.002191,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015276,"completed_at":"2026-10-10T10:50:08.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 333.742489] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aabff7e3149ab9efbe6d47f","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aabff7e3149ab9efbe6d47f: start","job_status":"start","queue_duration_s":2.316577,"scheduling_latency_s":2.316595}1664gitlab # [ 333.755843] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aabff7e3149ab9efbe6d47f","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aabff7e3149ab9efbe6d47f: done: 0.017285 sec","job_status":"done","queue_duration_s":2.316577,"scheduling_latency_s":2.316595,"redis_calls":13,"redis_duration_s":0.002258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001513,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017285,"completed_at":"2026-10-10T10:50:08.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 333.798099] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"134b602cbf52d846a352b38d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-134b602cbf52d846a352b38d: start","job_status":"start","queue_duration_s":2.335267,"scheduling_latency_s":2.335284}1666gitlab # [ 333.812360] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"134b602cbf52d846a352b38d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-134b602cbf52d846a352b38d: done: 0.017172 sec","job_status":"done","queue_duration_s":2.335267,"scheduling_latency_s":2.335284,"redis_calls":13,"redis_duration_s":0.002114,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017172,"completed_at":"2026-10-10T10:50:08.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 333.856501] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"addcb034f23b6d3445a0a20d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-addcb034f23b6d3445a0a20d: start","job_status":"start","queue_duration_s":2.353786,"scheduling_latency_s":2.353804}1668gitlab # [ 333.869585] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"addcb034f23b6d3445a0a20d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-addcb034f23b6d3445a0a20d: done: 0.017634 sec","job_status":"done","queue_duration_s":2.353786,"scheduling_latency_s":2.353804,"redis_calls":13,"redis_duration_s":0.002078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017634,"completed_at":"2026-10-10T10:50:08.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 333.910793] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16854255275f1f9740a38dc","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16854255275f1f9740a38dc: start","job_status":"start","queue_duration_s":2.37276,"scheduling_latency_s":2.372779}1670gitlab # [ 333.924099] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16854255275f1f9740a38dc","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16854255275f1f9740a38dc: done: 0.01952 sec","job_status":"done","queue_duration_s":2.37276,"scheduling_latency_s":2.372779,"redis_calls":13,"redis_duration_s":0.0021449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01952,"completed_at":"2026-10-10T10:50:08.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 333.966608] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f4b0135239b41ed0813203","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f4b0135239b41ed0813203: start","job_status":"start","queue_duration_s":2.393542,"scheduling_latency_s":2.393561}1672gitlab # [ 333.979917] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f4b0135239b41ed0813203","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f4b0135239b41ed0813203: done: 0.017507 sec","job_status":"done","queue_duration_s":2.393542,"scheduling_latency_s":2.393561,"redis_calls":13,"redis_duration_s":0.001944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017507,"completed_at":"2026-10-10T10:50:08.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 334.021762] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17f10786bfdb3b008015ce1a","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17f10786bfdb3b008015ce1a: start","job_status":"start","queue_duration_s":2.412408,"scheduling_latency_s":2.412428}1674gitlab # [ 334.034916] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17f10786bfdb3b008015ce1a","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17f10786bfdb3b008015ce1a: done: 0.017311 sec","job_status":"done","queue_duration_s":2.412408,"scheduling_latency_s":2.412428,"redis_calls":13,"redis_duration_s":0.00201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017311,"completed_at":"2026-10-10T10:50:08.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 334.076394] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:08.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c4758fd2a31b6c87767aae1","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c4758fd2a31b6c87767aae1: start","job_status":"start","queue_duration_s":2.431009,"scheduling_latency_s":2.431027}1676gitlab # [ 334.089473] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c4758fd2a31b6c87767aae1","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c4758fd2a31b6c87767aae1: done: 0.01785 sec","job_status":"done","queue_duration_s":2.431009,"scheduling_latency_s":2.431027,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01785,"completed_at":"2026-10-10T10:50:09.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 334.130866] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"146ccd0f8eb48d3637fea36d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-146ccd0f8eb48d3637fea36d: start","job_status":"start","queue_duration_s":2.45003,"scheduling_latency_s":2.450047}1678gitlab # [ 334.145025] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"146ccd0f8eb48d3637fea36d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-146ccd0f8eb48d3637fea36d: done: 0.015954 sec","job_status":"done","queue_duration_s":2.45003,"scheduling_latency_s":2.450047,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015954,"completed_at":"2026-10-10T10:50:09.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 334.186548] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f76d2852c7377bbc69f21f4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f76d2852c7377bbc69f21f4: start","job_status":"start","queue_duration_s":2.467198,"scheduling_latency_s":2.467215}1680gitlab # [ 334.199884] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f76d2852c7377bbc69f21f4","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f76d2852c7377bbc69f21f4: done: 0.016022 sec","job_status":"done","queue_duration_s":2.467198,"scheduling_latency_s":2.467215,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016022,"completed_at":"2026-10-10T10:50:09.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 334.241454] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c0284b88685e8b499afda0d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c0284b88685e8b499afda0d: start","job_status":"start","queue_duration_s":2.484382,"scheduling_latency_s":2.484401}1682gitlab # [ 334.254614] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c0284b88685e8b499afda0d","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c0284b88685e8b499afda0d: done: 0.019994 sec","job_status":"done","queue_duration_s":2.484382,"scheduling_latency_s":2.484401,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019994,"completed_at":"2026-10-10T10:50:09.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 334.296264] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40c80992aedc512b3ccff3c","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40c80992aedc512b3ccff3c: start","job_status":"start","queue_duration_s":2.505669,"scheduling_latency_s":2.505688}1684gitlab # [ 334.309428] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40c80992aedc512b3ccff3c","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40c80992aedc512b3ccff3c: done: 0.017934 sec","job_status":"done","queue_duration_s":2.505669,"scheduling_latency_s":2.505688,"redis_calls":13,"redis_duration_s":0.0017469999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017934,"completed_at":"2026-10-10T10:50:09.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 334.351720] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29342a3fbc74eda0026ab1f5","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29342a3fbc74eda0026ab1f5: start","job_status":"start","queue_duration_s":2.524929,"scheduling_latency_s":2.524948}1686gitlab # [ 334.364944] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29342a3fbc74eda0026ab1f5","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29342a3fbc74eda0026ab1f5: done: 0.018302 sec","job_status":"done","queue_duration_s":2.524929,"scheduling_latency_s":2.524948,"redis_calls":13,"redis_duration_s":0.0019060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018302,"completed_at":"2026-10-10T10:50:09.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 334.406903] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018ea2a09fdab342eed163d3","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018ea2a09fdab342eed163d3: start","job_status":"start","queue_duration_s":2.546337,"scheduling_latency_s":2.546358}1688gitlab # [ 334.420153] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018ea2a09fdab342eed163d3","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018ea2a09fdab342eed163d3: done: 0.017647 sec","job_status":"done","queue_duration_s":2.546337,"scheduling_latency_s":2.546358,"redis_calls":13,"redis_duration_s":0.0019089999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017647,"completed_at":"2026-10-10T10:50:09.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 334.461780] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c994fa7c947412ddc38a1230","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c994fa7c947412ddc38a1230: start","job_status":"start","queue_duration_s":2.565244,"scheduling_latency_s":2.565264}1690gitlab # [ 334.474953] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c994fa7c947412ddc38a1230","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c994fa7c947412ddc38a1230: done: 0.017486 sec","job_status":"done","queue_duration_s":2.565244,"scheduling_latency_s":2.565264,"redis_calls":13,"redis_duration_s":0.0017590000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017486,"completed_at":"2026-10-10T10:50:09.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 334.516668] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558554d3eeb048f813ee0207","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558554d3eeb048f813ee0207: start","job_status":"start","queue_duration_s":2.584088,"scheduling_latency_s":2.584107}1692gitlab # [ 334.530277] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558554d3eeb048f813ee0207","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558554d3eeb048f813ee0207: done: 0.192294 sec","job_status":"done","queue_duration_s":2.584088,"scheduling_latency_s":2.584107,"redis_calls":13,"redis_duration_s":0.06379599999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.062507,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.192294,"completed_at":"2026-10-10T10:50:09.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 334.576058] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aa51eced03c0a7e31b3ce93","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aa51eced03c0a7e31b3ce93: start","job_status":"start","queue_duration_s":2.780986,"scheduling_latency_s":2.781024}1694gitlab # [ 334.589098] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aa51eced03c0a7e31b3ce93","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aa51eced03c0a7e31b3ce93: done: 0.023656 sec","job_status":"done","queue_duration_s":2.780986,"scheduling_latency_s":2.781024,"redis_calls":13,"redis_duration_s":0.0031139999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023656,"completed_at":"2026-10-10T10:50:09.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 334.630778] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a44e70a003866d7fba2c04","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a44e70a003866d7fba2c04: start","job_status":"start","queue_duration_s":2.806505,"scheduling_latency_s":2.806533}1696gitlab # [ 334.643830] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a44e70a003866d7fba2c04","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a44e70a003866d7fba2c04: done: 0.021968 sec","job_status":"done","queue_duration_s":2.806505,"scheduling_latency_s":2.806533,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021968,"completed_at":"2026-10-10T10:50:09.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 334.685563] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89fc78f21fa15ed1e2c1fbe9","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89fc78f21fa15ed1e2c1fbe9: start","job_status":"start","queue_duration_s":2.830127,"scheduling_latency_s":2.83015}1698gitlab # [ 334.698741] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89fc78f21fa15ed1e2c1fbe9","created_at":"2026-10-10T10:50:06.186Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-5a169a63af5e444f","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b65e21ca5cdd18becacb7c905bf917d9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:06.556Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89fc78f21fa15ed1e2c1fbe9: done: 0.016094 sec","job_status":"done","queue_duration_s":2.830127,"scheduling_latency_s":2.83015,"redis_calls":13,"redis_duration_s":0.001912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001239,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016094,"completed_at":"2026-10-10T10:50:09.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 334.740596] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.404Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"6d8c88b71111870bee90a8b3","created_at":"2026-10-10T10:50:07.897Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-c863a4067de54528","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:07.905Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-6d8c88b71111870bee90a8b3: start","job_status":"start","queue_duration_s":1.498308,"scheduling_latency_s":1.498325}1700gitlab # [ 334.757612] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.437Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"6d8c88b71111870bee90a8b3","created_at":"2026-10-10T10:50:07.897Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-c863a4067de54528","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:07.905Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-6d8c88b71111870bee90a8b3: done: 0.032836 sec","job_status":"done","queue_duration_s":1.498308,"scheduling_latency_s":1.498325,"redis_calls":10,"redis_duration_s":0.002218,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003828,"duration_s":0.032836,"completed_at":"2026-10-10T10:50:09.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 334.804602] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.438Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"c3a347be2364e443a74aee0d","created_at":"2026-10-10T10:50:07.906Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-c863a4067de54528","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:07.911Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-c3a347be2364e443a74aee0d: start","job_status":"start","queue_duration_s":1.527037,"scheduling_latency_s":1.527062}1702gitlab # [ 334.821800] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:09.466Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"c3a347be2364e443a74aee0d","created_at":"2026-10-10T10:50:07.906Z","trace_propagation_headers":{"sentry-trace":"2a1eb749683749e08c8bf11e6a97f33b-c863a4067de54528","baggage":"sentry-trace_id=2a1eb749683749e08c8bf11e6a97f33b,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"0bbfcc082e1e94944727f0c717c7a24b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:07.911Z","job_size_bytes":2,"pid":2168,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-c3a347be2364e443a74aee0d: done: 0.027772 sec","job_status":"done","queue_duration_s":1.527037,"scheduling_latency_s":1.527062,"redis_calls":10,"redis_duration_s":0.002146,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033842,"duration_s":0.027772,"completed_at":"2026-10-10T10:50:09.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 350.273016] postgres[3646]: [3646] ERROR: relation "table_without_models" does not exist1704gitlab # [ 350.275104] postgres[3646]: [3646] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1705gitlab # [ 355.951659] runuser[3261]: pam_unix(runuser:session): session closed for user gitlab1706gitlab # [ 355.953097] setup-gitlab-start[3235]: + systemctl restart gitlab-sidekiq.service1707gitlab # [ 355.980584] systemd[1]: Stopping gitlab-sidekiq.service...1708gitlab # [ 355.984072] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:32.847Z","message":"Shutting down"}1709gitlab # [ 355.986497] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:32.847Z","message":"Scheduler exiting..."}1710gitlab # [ 355.988920] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:32.848Z","message":"Terminating quiet threads for default capsule"}1711gitlab # [ 355.991696] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:32.848Z","message":"Scheduler exiting..."}1712gitlab # [ 356.482833] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:33.349Z","message":"Pausing to allow jobs to finish..."}1713gitlab # [ 357.985987] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:34.851Z","message":"Bye!"}1714gitlab # [ 358.013208] sidekiq-cluster[2168]: {"severity":"INFO","time":"2026-10-10T10:50:34.879Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2168,"worker_id":"sidekiq_0","memwd_rss_bytes":930787328,"retry":0}1715gitlab # [ 358.855581] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1716gitlab # [ 358.855915] systemd[1]: Stopped gitlab-sidekiq.service.1717gitlab # [ 358.856104] systemd[1]: gitlab-sidekiq.service: Consumed 2min 13.115s CPU time over 3min 45.072s wall clock time, 937.6M memory peak, 4.5M read from disk.1718gitlab # [ 358.864514] systemd[1]: Started gitlab-sidekiq.service.1719gitlab # [ 358.868532] setup-gitlab-start[3235]: + mkdir -p /var/lib/secrets1720gitlab # [ 358.871623] setup-gitlab-start[3235]: + echo nixbot-test-token-of-20-chars1721gitlab # [ 358.873285] setup-gitlab-start[3235]: + chmod 644 /var/lib/secrets/gitlab-token1722gitlab # [ 358.875334] setup-gitlab-start[3235]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1723gitlab # [ 359.342588] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:36 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 4411724gitlab # [ 360.659357] gitaly[903]: time="2026-10-10T10:50:37.525Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.525" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 360.659718] gitaly[903]: time="2026-10-10T10:50:37.526Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.525" grpc.time_ms=0.664 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 360.843754] gitaly[903]: time="2026-10-10T10:50:37.710Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.189" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.710" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 360.862122] gitaly[903]: time="2026-10-10T10:50:37.728Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.189" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.710" grpc.time_ms=18.52 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1728gitlab # [ 360.918115] gitaly[903]: time="2026-10-10T10:50:37.784Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 diskcache=ea87001f-465e-46b2-b487-51c1d20dbb99 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-10T10:50:47.219" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.740" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 360.935714] gitaly[903]: time="2026-10-10T10:50:37.785Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1442 command.oublock=32 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-10T10:50:47.219" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.740" grpc.time_ms=44.639 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 360.958781] gitaly[903]: time="2026-10-10T10:50:37.801Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.800" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1731gitlab # [ 360.973794] gitaly[903]: time="2026-10-10T10:50:37.801Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.800" grpc.time_ms=0.904 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 360.989195] gitaly[903]: time="2026-10-10T10:50:37.818Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:47.286" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.807" grpc.time_ms=10.617 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 361.055271] gitaly[903]: time="2026-10-10T10:50:37.922Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.921" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab # [ 361.072221] gitaly[903]: time="2026-10-10T10:50:37.922Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.921" grpc.time_ms=0.416 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735gitlab # [ 361.095925] gitaly[903]: time="2026-10-10T10:50:37.962Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 diskcache=8ecb571f-2979-47b6-8fbf-5f00931c76f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-10T10:50:47.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.924" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 361.113146] gitaly[903]: time="2026-10-10T10:50:37.963Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-10T10:50:47.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.924" grpc.time_ms=37.951 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 361.136759] gitaly[903]: time="2026-10-10T10:50:37.970Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.049" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.969" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1738gitlab # [ 361.153607] gitaly[903]: time="2026-10-10T10:50:37.970Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:47.049" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.969" grpc.time_ms=0.814 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1739gitlab # [ 361.169852] gitaly[903]: time="2026-10-10T10:50:37.985Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:47.055" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:37.975" grpc.time_ms=9.548 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 361.186310] gitaly[903]: time="2026-10-10T10:50:38.028Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:50:48.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:38.027" grpc.time_ms=0.308 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1741gitlab # [ 361.198906] gitaly[903]: time="2026-10-10T10:50:38.039Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-10T10:50:48.017" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:38.038" grpc.time_ms=0.484 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 361.881349] gitaly[903]: time="2026-10-10T10:50:38.747Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZ9A4AVV2HVZRP1CTTRR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:48.215" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:38.736" grpc.time_ms=10.87 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 362.291134] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:39 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 29281744gitlab # [ 362.294889] setup-gitlab-start[3714]: {"id":1,"message":null,"error":null}1745gitlab # [ 364.813216] sidekiq-cluster[3697]: {"severity":"INFO","time":"2026-10-10T10:50:41.644Z","message":"Starting cluster with 1 processes"}1746gitlab # [ 367.944726] gitaly[903]: time="2026-10-10T10:50:44.810Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZH2R0V238W5MNYFRG46X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:54.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:44.801" grpc.time_ms=9.28 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 368.621703] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:45 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 13031748gitlab # [ 368.629520] setup-gitlab-start[3235]: + mkdir -p /tmp/test-flake1749gitlab # [ 368.631531] setup-gitlab-start[3235]: + cd /tmp/test-flake1750gitlab # [ 368.633173] setup-gitlab-start[3235]: + git init -b master1751gitlab # [ 368.652796] setup-gitlab-start[3803]: Initialized empty Git repository in /tmp/test-flake/.git/1752gitlab # [ 368.654837] setup-gitlab-start[3235]: + git config user.name test1753gitlab # [ 368.656324] setup-gitlab-start[3235]: + git config user.email test@example.com1754gitlab # [ 368.659570] setup-gitlab-start[3235]: + cat1755gitlab # [ 368.662453] setup-gitlab-start[3235]: + git add flake.nix1756gitlab # [ 368.666506] setup-gitlab-start[3235]: + git commit -m 'initial commit'1757gitlab # [ 368.688727] setup-gitlab-start[3808]: [master (root-commit) 6517f7c] initial commit1758gitlab # [ 368.690484] setup-gitlab-start[3808]: 1 file changed, 10 insertions(+)1759gitlab # [ 368.691910] setup-gitlab-start[3808]: create mode 100644 flake.nix1760gitlab # [ 368.694179] setup-gitlab-start[3235]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1761gitlab # [ 368.700718] setup-gitlab-start[3235]: + git push -u origin master1762gitlab # [ 368.783269] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 521763gitlab # [ 369.119761] gitaly[903]: time="2026-10-10T10:50:45.985Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJGMXY38A81WZCTK08K7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:45.974" grpc.time_ms=11.73 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 369.143005] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 3351765gitlab # [ 369.425465] gitaly[903]: time="2026-10-10T10:50:46.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:56.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:46.280" grpc.time_ms=11.708 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 369.509204] gitaly[903]: time="2026-10-10T10:50:46.375Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-10T10:51:16.063" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-10T10:50:46.363" grpc.time_ms=12.078 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 369.585272] gitaly[903]: time="2026-10-10T10:50:46.451Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA duration_ms=279ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1768gitlab # [ 369.647369] gitaly[903]: time="2026-10-10T10:50:46.514Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA duration_ms=62ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1769gitlab # [ 369.652570] gitaly[903]: time="2026-10-10T10:50:46.514Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:46.169" grpc.time_ms=344.8 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1770gitlab # [ 369.685892] gitaly[903]: time="2026-10-10T10:50:46.552Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:46.551" grpc.time_ms=1.051 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1771gitlab # [ 369.746100] gitaly[903]: time="2026-10-10T10:50:46.612Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:46.611" grpc.time_ms=0.884 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1772gitlab # [ 369.799031] gitaly[903]: time="2026-10-10T10:50:46.665Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:46.665" grpc.time_ms=0.664 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1773gitlab # [ 369.955672] gitaly[903]: time="2026-10-10T10:50:46.822Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:50:56.290" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:46.810" grpc.time_ms=11.361 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 369.993944] gitaly[903]: time="2026-10-10T10:50:46.860Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=5 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-10T10:50:56.002" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:46.833" grpc.time_ms=26.921 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 370.023860] gitaly[903]: time="2026-10-10T10:50:46.890Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA duration_ms=172ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1776gitlab # [ 370.030297] gitaly[903]: time="2026-10-10T10:50:46.897Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:46.717" grpc.time_ms=179.261 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1777gitlab # [ 370.055067] gitaly[903]: time="2026-10-10T10:50:46.921Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA diskcache=6f1345f7-656b-4f3c-806b-a9d886f60475 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:46.093" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1778gitlab # [ 370.067950] gitaly[903]: time="2026-10-10T10:50:46.922Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=237 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13412 command.oublock=32 command.real_time_ms=820 command.spawn_token_fork_ms=0 command.system_time_ms=130 command.user_time_ms=107 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:46.093" grpc.time_ms=828.125 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1779gitlab # [ 370.083743] setup-gitlab-start[3812]: To http://gitlab/root/test-flake.git1780gitlab # [ 370.084985] setup-gitlab-start[3812]: * [new branch] master -> master1781gitlab # [ 370.086022] setup-gitlab-start[3812]: branch 'master' set up to track 'origin/master'.1782gitlab # [ 370.087605] gitlab-workhorse[819]: time="2026-10-10T10:50:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521783gitlab # [ 370.089977] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9211784gitlab # [ 370.092517] systemd[1]: Finished setup-gitlab.service.1785gitlab # [ 370.093535] systemd[1]: Starting nixbot CI service...1786gitlab: (finished: waiting for unit setup-gitlab.service, in 371.26 seconds)1787gitlab: waiting for unit nixbot.service1788gitlab # [ 371.418052] nixbot[3889]: {"ts": "2026-10-10T10:50:48.284Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1789gitlab # [ 371.449918] nixbot[3889]: {"ts": "2026-10-10T10:50:48.316Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1790gitlab # [ 371.475361] nixbot[3889]: {"ts": "2026-10-10T10:50:48.342Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1791gitlab # [ 371.480820] nixbot[3889]: {"ts": "2026-10-10T10:50:48.347Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1792gitlab # [ 371.486047] nixbot[3889]: {"ts": "2026-10-10T10:50:48.352Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1793gitlab # [ 371.493748] nixbot[3889]: {"ts": "2026-10-10T10:50:48.360Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1794gitlab # [ 371.498939] nixbot[3889]: {"ts": "2026-10-10T10:50:48.365Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1795gitlab # [ 371.502515] nixbot[3889]: {"ts": "2026-10-10T10:50:48.368Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1796gitlab # [ 371.508304] nixbot[3889]: {"ts": "2026-10-10T10:50:48.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1797gitlab # [ 371.511720] nixbot[3889]: {"ts": "2026-10-10T10:50:48.376Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1798gitlab # [ 371.515360] nixbot[3889]: {"ts": "2026-10-10T10:50:48.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1799gitlab # [ 371.521555] nixbot[3889]: {"ts": "2026-10-10T10:50:48.388Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1800gitlab # [ 371.525069] nixbot[3889]: {"ts": "2026-10-10T10:50:48.391Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1801gitlab # [ 371.528566] nixbot[3889]: {"ts": "2026-10-10T10:50:48.393Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1802gitlab # [ 371.532193] nixbot[3889]: {"ts": "2026-10-10T10:50:48.396Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1803gitlab # [ 371.535789] nixbot[3889]: {"ts": "2026-10-10T10:50:48.398Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1804gitlab # [ 371.540462] nixbot[3889]: {"ts": "2026-10-10T10:50:48.399Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1805gitlab # [ 371.543951] nixbot[3889]: {"ts": "2026-10-10T10:50:48.400Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1806gitlab # [ 371.547462] nixbot[3889]: {"ts": "2026-10-10T10:50:48.405Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1807gitlab # [ 371.551138] nixbot[3889]: {"ts": "2026-10-10T10:50:48.406Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1808gitlab # [ 371.554986] nixbot[3889]: {"ts": "2026-10-10T10:50:48.408Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1809gitlab # [ 371.558580] nixbot[3889]: {"ts": "2026-10-10T10:50:48.413Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1810gitlab # [ 371.562080] nixbot[3889]: {"ts": "2026-10-10T10:50:48.414Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1811gitlab # [ 371.565441] nixbot[3889]: {"ts": "2026-10-10T10:50:48.416Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1812gitlab # [ 371.568615] nixbot[3889]: {"ts": "2026-10-10T10:50:48.417Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1813gitlab # [ 371.571811] nixbot[3889]: {"ts": "2026-10-10T10:50:48.419Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1814gitlab # [ 371.575195] nixbot[3889]: {"ts": "2026-10-10T10:50:48.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1815gitlab # [ 371.578444] nixbot[3889]: {"ts": "2026-10-10T10:50:48.422Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1816gitlab # [ 371.581536] nixbot[3889]: {"ts": "2026-10-10T10:50:48.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1817gitlab # [ 371.584548] nixbot[3889]: {"ts": "2026-10-10T10:50:48.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1818gitlab # [ 371.587355] nixbot[3889]: {"ts": "2026-10-10T10:50:48.439Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1819gitlab # [ 371.590383] nixbot[3889]: {"ts": "2026-10-10T10:50:48.441Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1820gitlab # [ 371.593369] nixbot[3889]: {"ts": "2026-10-10T10:50:48.442Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1821gitlab # [ 371.596174] nixbot[3889]: {"ts": "2026-10-10T10:50:48.446Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1822gitlab # [ 371.598960] nixbot[3889]: {"ts": "2026-10-10T10:50:48.447Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1823gitlab # [ 371.601756] nixbot[3889]: {"ts": "2026-10-10T10:50:48.452Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1824gitlab # [ 371.604531] nixbot[3889]: {"ts": "2026-10-10T10:50:48.455Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1825gitlab # [ 371.607041] nixbot[3889]: {"ts": "2026-10-10T10:50:48.459Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1826gitlab # [ 372.015568] nixbot[3889]: {"ts": "2026-10-10T10:50:48.882Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [3889]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1827gitlab # [ 372.019799] nixbot[3889]: {"ts": "2026-10-10T10:50:48.882Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1828gitlab # [ 372.058367] nixbot[3889]: {"ts": "2026-10-10T10:50:48.924Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:42998 - \"GET /health HTTP/1.1\" 200"}1829gitlab # [ 372.068418] systemd[1]: Started nixbot CI service.1830gitlab # [ 372.069736] systemd[1]: Reached target Multi-User System.1831gitlab # [ 372.071512] systemd[1]: Startup finished in 719ms (kernel) + 3.747s (initrd) + 6min 7.604s (userspace) = 6min 12.071s.1832gitlab # [ 372.383443] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3261833gitlab # [ 372.409434] nixbot[3889]: {"ts": "2026-10-10T10:50:49.276Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1834gitlab # [ 372.494740] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 761835gitlab # [ 372.499466] nixbot[3889]: {"ts": "2026-10-10T10:50:49.365Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1836gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1837gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1838gitlab # [ 372.835487] nixbot[3889]: {"ts": "2026-10-10T10:50:49.702Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:41436 - \"GET /health HTTP/1.1\" 200"}1839gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1840subtest: project discovered and webhook registered1841gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1842gitlab # [ 372.876543] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 3741843gitlab # [ 373.035377] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 1641844gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1845(finished: subtest: project discovered and webhook registered, in 0.20 seconds)1846subtest: push delivers the webhook1847gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1848gitlab # [ 373.146428] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2571849gitlab # [ 373.263840] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 1061850gitlab # [ 373.380540] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 1091851gitlab # [ 373.481538] gitaly[903]: time="2026-10-10T10:50:50.347Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQ0FB355N957GN9M52FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-10T10:51:20.029" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:50.329" grpc.time_ms=16.907 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 373.507717] gitaly[903]: time="2026-10-10T10:50:50.369Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQ0FB355N957GN9M52FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:20.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:50:50.367" grpc.time_ms=1.129 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 373.528956] gitaly[903]: time="2026-10-10T10:50:50.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQ0FB355N957GN9M52FS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-10T10:51:00.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:50:50.373" grpc.time_ms=11.636 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 373.567737] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1781855gitlab # [ 373.682868] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1091856gitlab # [ 373.690898] nixbot[3889]: {"ts": "2026-10-10T10:50:50.556Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1857gitlab # [ 373.862294] gitaly[903]: time="2026-10-10T10:50:50.729Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZQCFP275TZQX3QEJPTBS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.717" grpc.time_ms=11.335 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1858gitlab # [ 373.883823] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 911859gitlab # [ 374.027195] gitaly[903]: time="2026-10-10T10:50:50.893Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQFB2JCH81J17DWK92FT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.881" pid=903 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1860gitlab # [ 374.044595] gitaly[903]: time="2026-10-10T10:50:50.894Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQFB2JCH81J17DWK92FT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.881" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861gitlab # [ 374.063713] gitlab-workhorse[819]: time="2026-10-10T10:50:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131862gitlab # [ 374.066253] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1631863gitlab # [ 374.068756] gitaly[903]: time="2026-10-10T10:50:50.894Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQFB2JCH81J17DWK92FT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.881" grpc.time_ms=13.074 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1864gitlab # [ 374.150330] gitaly[903]: time="2026-10-10T10:50:51.016Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQMMF6MBCE59GZHX7M3Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.994" pid=903 remote_ip="2001:db8:1::1" request_sha=9e140f18c86d2222fa26a67fee4e936414c1b479 response_bytes=224 span.kind=server system=grpc1865gitlab # [ 374.165492] gitaly[903]: time="2026-10-10T10:50:51.017Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQMMF6MBCE59GZHX7M3Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.994" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1866gitlab # [ 374.183519] gitlab-workhorse[819]: time="2026-10-10T10:50:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241867gitlab # [ 374.185948] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 1171868gitlab # [ 374.188431] gitaly[903]: time="2026-10-10T10:50:51.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQMMF6MBCE59GZHX7M3Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:50.994" grpc.time_ms=23.004 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1869gitlab # [ 374.303658] gitaly[903]: time="2026-10-10T10:50:51.170Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZQT3V5HJ13Z37ZAAGHPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.158" grpc.time_ms=11.807 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1870gitlab # [ 374.325486] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 961871gitlab # [ 374.390019] gitaly[903]: time="2026-10-10T10:50:51.256Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQX568BD99T5YKSZPTWY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.245" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1872gitlab # [ 374.408148] gitaly[903]: time="2026-10-10T10:50:51.256Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQX568BD99T5YKSZPTWY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.245" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1873gitlab # [ 374.430983] gitlab-workhorse[819]: time="2026-10-10T10:50:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671874gitlab # [ 374.434159] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 831875gitlab # [ 374.437233] gitaly[903]: time="2026-10-10T10:50:51.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZQX568BD99T5YKSZPTWY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.245" grpc.time_ms=11.156 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1876gitlab # [ 374.502837] gitaly[903]: time="2026-10-10T10:50:51.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR16C8E4TSCT4KF06GAC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.357" grpc.time_ms=11.495 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1877gitlab # [ 374.525094] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 671878gitlab # [ 374.585053] gitaly[903]: time="2026-10-10T10:50:51.451Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR3C1DJ4X42SA3C1RGWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.431" pid=903 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1879gitlab # [ 374.602628] gitaly[903]: time="2026-10-10T10:50:51.452Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR3C1DJ4X42SA3C1RGWH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.431" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1880gitlab # [ 374.627828] gitlab-workhorse[819]: time="2026-10-10T10:50:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091881gitlab # [ 374.630939] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 801882gitlab # [ 374.633949] gitaly[903]: time="2026-10-10T10:50:51.452Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR3C1DJ4X42SA3C1RGWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:50:51.431" grpc.time_ms=20.697 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1883gitlab # [ 374.733565] gitaly[903]: time="2026-10-10T10:50:51.600Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:21.298" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:50:51.599" grpc.time_ms=0.858 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 374.797879] gitaly[903]: time="2026-10-10T10:50:51.664Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=588 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-10T10:51:21.352" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:51.652" grpc.time_ms=11.987 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 374.859416] gitaly[903]: time="2026-10-10T10:50:51.726Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:51:01.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:51.713" grpc.time_ms=12.184 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 374.888700] gitaly[903]: time="2026-10-10T10:50:51.755Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:51:01.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:51.743" grpc.time_ms=11.519 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 375.013336] gitaly[903]: time="2026-10-10T10:50:51.880Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-10T10:51:01.088" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:51.879" grpc.time_ms=0.424 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 375.052105] gitaly[903]: time="2026-10-10T10:50:51.918Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-10T10:51:01.116" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:50:51.907" grpc.time_ms=11.272 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 375.123187] gitaly[903]: time="2026-10-10T10:50:51.989Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:51.989" grpc.time_ms=0.815 pid=903 span.kind=server system=grpc1890gitlab # [ 375.169846] gitaly[903]: time="2026-10-10T10:50:52.036Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:50:52.033" grpc.time_ms=1.963 pid=903 span.kind=server system=grpc1891gitlab # [ 375.193403] gitaly[903]: time="2026-10-10T10:50:52.060Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H diskcache=33a427aa-937e-4a4d-94da-6056d51be5f1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:51:01.154" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:51.944" pid=903 ref=refs/keep-around/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 remote_ip="2001:db8:1::1" revision=6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 span.kind=server system=grpc username=root1892gitlab # [ 375.213107] gitaly[903]: time="2026-10-10T10:50:52.060Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5172 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=0 command.system_time_ms=58 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:51:01.154" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:50:51.944" grpc.time_ms=115.822 pid=903 ref=refs/keep-around/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 remote_ip="2001:db8:1::1" revision=6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 span.kind=server system=grpc username=root1893gitlab # [ 375.235894] gitaly[903]: time="2026-10-10T10:50:52.067Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:22.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:50:52.066" grpc.time_ms=0.565 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 375.433007] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:50:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 7901895gitlab # [ 375.447809] nixbot[3889]: {"ts": "2026-10-10T10:50:52.313Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-6517f7ca3a65-0"}1896gitlab # [ 375.666096] nixbot[3889]: {"ts": "2026-10-10T10:50:52.532Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-6517f7ca3a65-0", "argv0": "bwrap"}1897gitlab # [ 375.800599] systemd[1]: Started Nix Daemon.1898gitlab # [ 375.878617] nix-daemon[4054]: accepted connection from pid 4049, user nixbot1899gitlab # [ 380.196170] nix-daemon[4054]: accepted connection from pid 4093, user nixbot1900gitlab # [ 380.213199] nix-daemon[4054]: accepted connection from pid 4049, user nixbot1901gitlab # [ 384.252275] nix-daemon[4054]: accepted connection from pid 4049, user nixbot1902gitlab # [ 384.402640] gitaly[903]: time="2026-10-10T10:51:01.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ01NV43Y6T1EG4K2PW9VV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:31.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:51:01.267" grpc.time_ms=0.88 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 384.542187] gitaly[903]: time="2026-10-10T10:51:01.408Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ01NV43Y6T1EG4K2PW9VV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:51:11.027" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:51:01.397" grpc.time_ms=10.862 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 384.670786] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3571905gitlab # [ 384.752498] gitaly[903]: time="2026-10-10T10:51:01.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ02160Q4QSSN0ZDYK0G1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:31.317" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:51:01.618" grpc.time_ms=0.918 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 384.906286] gitaly[903]: time="2026-10-10T10:51:01.772Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ02160Q4QSSN0ZDYK0G1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:51:11.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:51:01.761" grpc.time_ms=11.557 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 384.969888] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2941908gitlab # [ 385.049786] gitaly[903]: time="2026-10-10T10:51:01.916Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ02AY4GE3RV7EBGQCC2NJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:51:31.614" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:51:01.915" grpc.time_ms=0.826 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 385.092062] gitaly[903]: time="2026-10-10T10:51:01.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ02AY4GE3RV7EBGQCC2NJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:51:11.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:51:01.948" grpc.time_ms=10.246 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 385.158680] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1671911gitlab # [ 385.453940] nixbot[3889]: {"ts": "2026-10-10T10:51:02.319Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "6517f7ca3a65df2a6b8df0ed7f5b05aa09627135", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1912gitlab # [ 385.606845] gitaly[903]: time="2026-10-10T10:51:02.473Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ02TZMG2VTZZ0AZDMS2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.461" grpc.time_ms=11.397 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913gitlab # [ 385.629483] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1051914gitlab # [ 385.712672] gitaly[903]: time="2026-10-10T10:51:02.579Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ02YB31AW10BFVZFWEZAD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.567" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1915gitlab # [ 385.729865] gitaly[903]: time="2026-10-10T10:51:02.579Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ02YB31AW10BFVZFWEZAD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.567" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916gitlab # [ 385.752195] gitlab-workhorse[819]: time="2026-10-10T10:51:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671917gitlab # [ 385.755229] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1041918gitlab # [ 385.759351] gitaly[903]: time="2026-10-10T10:51:02.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ02YB31AW10BFVZFWEZAD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.567" grpc.time_ms=12.276 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 385.871945] gitaly[903]: time="2026-10-10T10:51:02.738Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ033YQMXC7SEQ3V55HRY8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.728" grpc.time_ms=10.296 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 385.887012] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 841921gitlab # [ 385.972876] gitaly[903]: time="2026-10-10T10:51:02.839Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ036NEHZZJ0RXJJR2JD07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.827" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1922gitlab # [ 385.990260] gitaly[903]: time="2026-10-10T10:51:02.839Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ036NEHZZJ0RXJJR2JD07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.827" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab # [ 386.011895] gitlab-workhorse[819]: time="2026-10-10T10:51:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671924gitlab # [ 386.014731] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:51:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 991925gitlab # [ 386.017545] gitaly[903]: time="2026-10-10T10:51:02.840Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ036NEHZZJ0RXJJR2JD07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:51:02.827" grpc.time_ms=12.037 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1926gitlab # [ 409.849297] sidekiq-cluster[3767]: 2026-10-10T10:51:26.715Z pid=3767 tid=xzz INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3767, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434774016}1927gitlab # [ 410.172789] sidekiq-cluster[3767]: W, [2026-10-10T10:51:27.039445 #3767] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1928gitlab # [ 410.246661] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:51:27.113Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1929gitlab # [ 414.114133] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:51:30.980Z","message":"GitLab reliable fetch activated!"}1930gitlab # [ 414.114543] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:51:30.980Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1931gitlab # [ 452.613344] postgres[4686]: [4686] ERROR: relation "table_without_models" does not exist1932gitlab # [ 452.613767] postgres[4686]: [4686] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1933gitlab # [ 457.704531] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:14.570Z","message":"Booted Rails 7.2.3.1 application in production environment"}1934gitlab # [ 457.707761] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:14.573Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1935gitlab # [ 457.710205] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:14.573Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1936gitlab # [ 457.712047] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:14.574Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1937gitlab # [ 457.714094] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:14.576Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1938gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 85.09 seconds)1939gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1940gitlab # [ 458.275610] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 901941gitlab # [ 458.388608] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1121942gitlab # [ 458.391823] gitaly[903]: time="2026-10-10T10:52:15.255Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ29X6MVSN6VJAD3XKKT30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:15.241" grpc.time_ms=12.665 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1943gitlab # Enumerating objects: 5, done.1944gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1945gitlab # Delta compression using up to 4 threads1946gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1947gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1948gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1949gitlab # [ 458.771690] gitaly[903]: time="2026-10-10T10:52:15.638Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-10T10:52:45.328" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-10T10:52:15.628" grpc.time_ms=9.435 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 458.816211] gitaly[903]: time="2026-10-10T10:52:15.682Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4JQ2A1S02AET2EQX7335HH4 duration_ms=149ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1951gitlab # [ 458.868639] gitaly[903]: time="2026-10-10T10:52:15.735Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4JQ2A1S02AET2EQX7335HH4 duration_ms=51ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1952gitlab # [ 458.876333] gitaly[903]: time="2026-10-10T10:52:15.735Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:15.532" grpc.time_ms=203.65 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1953gitlab # [ 458.905596] gitaly[903]: time="2026-10-10T10:52:15.772Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:15.771" grpc.time_ms=0.797 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1954gitlab # [ 458.957820] gitaly[903]: time="2026-10-10T10:52:15.824Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:15.823" grpc.time_ms=0.635 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1955gitlab # [ 458.994247] gitaly[903]: time="2026-10-10T10:52:15.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:15.860" grpc.time_ms=0.601 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1956gitlab # [ 459.192443] gitaly[903]: time="2026-10-10T10:52:16.059Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4JQ2A1S02AET2EQX7335HH4 duration_ms=158ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1957gitlab # [ 459.198060] gitaly[903]: time="2026-10-10T10:52:16.060Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:15.898" grpc.time_ms=160.928 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1958gitlab # [ 459.223073] gitaly[903]: time="2026-10-10T10:52:16.089Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 diskcache=39bee146-ed5b-4992-96d8-5b12d9a0e7e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:15.465" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1959gitlab # To http://gitlab/root/test-flake.git1960gitlab # [ 459.236441] gitaly[903]: time="2026-10-10T10:52:16.090Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=230 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=12963 command.oublock=32 command.real_time_ms=619 command.spawn_token_fork_ms=0 command.system_time_ms=132 command.user_time_ms=98 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:15.465" grpc.time_ms=624.912 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1961gitlab # 6517f7c..37d46a4 [ 459.253299] gitlab-workhorse[819]: time="2026-10-10T10:52:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521962gitlab # master -> master[ 459.255639] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:16 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8011963gitlab # 1964gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.14 seconds)1965gitlab: must succeed: git -C /tmp/test-flake rev-parse master1966gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'1968gitlab # [ 459.425048] nixbot[3889]: {"ts": "2026-10-10T10:52:16.290Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:35960 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.14 seconds)1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'1971gitlab # [ 460.460549] nixbot[3889]: {"ts": "2026-10-10T10:52:17.326Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:35964 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.04 seconds)1973gitlab # [ 460.600232] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.465Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e6370c5f5e6aebb6067177e9","created_at":"2026-10-10T10:50:37.840Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:37.889Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e6370c5f5e6aebb6067177e9: start","job_status":"start","queue_duration_s":99.576295,"scheduling_latency_s":99.576362}1974gitlab # [ 460.816905] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.683Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e6370c5f5e6aebb6067177e9","created_at":"2026-10-10T10:50:37.840Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:37.889Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e6370c5f5e6aebb6067177e9: done: 0.217501 sec","job_status":"done","queue_duration_s":99.576295,"scheduling_latency_s":99.576362,"redis_calls":23,"redis_duration_s":0.006675,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003308,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1105984,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.217501,"completed_at":"2026-10-10T10:52:17.683Z","load_balancing_strategy":"primary","db_duration_s":0.065301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1975gitlab # [ 460.884762] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.684Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f09db5f7e56c4ce50f229384","created_at":"2026-10-10T10:50:37.906Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:37.914Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f09db5f7e56c4ce50f229384: start","job_status":"start","queue_duration_s":99.769967,"scheduling_latency_s":99.769991}1976gitlab # [ 460.931732] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.798Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f09db5f7e56c4ce50f229384","created_at":"2026-10-10T10:50:37.906Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:37.914Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f09db5f7e56c4ce50f229384: done: 0.113209 sec","job_status":"done","queue_duration_s":99.769967,"scheduling_latency_s":99.769991,"redis_calls":14,"redis_duration_s":0.0032370000000000003,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08719658,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.113209,"completed_at":"2026-10-10T10:52:17.798Z","load_balancing_strategy":"primary","db_duration_s":0.023887,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1977gitlab # [ 460.993035] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1e1d73b50ddef5cda23c2fd4","created_at":"2026-10-10T10:50:38.582Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.593Z","job_size_bytes":5,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1e1d73b50ddef5cda23c2fd4: start","job_status":"start","queue_duration_s":99.205784,"scheduling_latency_s":99.205804}1978gitlab # [ 461.107440] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.973Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1e1d73b50ddef5cda23c2fd4","created_at":"2026-10-10T10:50:38.582Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.593Z","job_size_bytes":5,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1e1d73b50ddef5cda23c2fd4: done: 0.174195 sec","job_status":"done","queue_duration_s":99.205784,"scheduling_latency_s":99.205804,"redis_calls":12,"redis_duration_s":0.002345,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027294,"duration_s":0.174195,"completed_at":"2026-10-10T10:52:17.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028832,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1979gitlab # [ 461.177572] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:17.975Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"88224fc91ba269d51c68695e","created_at":"2026-10-10T10:50:38.638Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.647Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-88224fc91ba269d51c68695e: start","job_status":"start","queue_duration_s":99.328185,"scheduling_latency_s":99.328206}1980gitlab # [ 461.333118] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:18.199Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"88224fc91ba269d51c68695e","created_at":"2026-10-10T10:50:38.638Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.647Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-88224fc91ba269d51c68695e: done: 0.223601 sec","job_status":"done","queue_duration_s":99.328185,"scheduling_latency_s":99.328206,"redis_calls":11,"redis_duration_s":0.002731,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.182,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.182,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053978,"duration_s":0.223601,"completed_at":"2026-10-10T10:52:18.199Z","load_balancing_strategy":"primary","db_duration_s":0.073598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 461.402156] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:18.201Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b9db3ccb1a98a9a0dc47dc71","created_at":"2026-10-10T10:50:38.653Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.661Z","job_size_bytes":89,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b9db3ccb1a98a9a0dc47dc71: start","job_status":"start","queue_duration_s":99.540408,"scheduling_latency_s":99.540436}1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'1983gitlab # [ 461.425291] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:18.255Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b9db3ccb1a98a9a0dc47dc71","created_at":"2026-10-10T10:50:38.653Z","trace_propagation_headers":{"sentry-trace":"c5a5a8da936949c3937af30605007148-74ce132e734f45a8","baggage":"sentry-trace_id=c5a5a8da936949c3937af30605007148,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZ9A4AVV2HVZRP1CTTRR5","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:38.661Z","job_size_bytes":89,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b9db3ccb1a98a9a0dc47dc71: done: 0.053497 sec","job_status":"done","queue_duration_s":99.540408,"scheduling_latency_s":99.540436,"redis_calls":11,"redis_duration_s":0.002445,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033812,"duration_s":0.053497,"completed_at":"2026-10-10T10:52:18.255Z","load_balancing_strategy":"primary","db_duration_s":0.006784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1984gitlab # [ 461.477295] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:18.256Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"cacc0353d916781b66cdf576","created_at":"2026-10-10T10:50:46.778Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-27cd1468a8b24c23","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:46.786Z","job_size_bytes":185,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-cacc0353d916781b66cdf576: start","job_status":"start","queue_duration_s":91.470249,"scheduling_latency_s":91.470273}1985gitlab # [ 461.495459] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:18.278Z","message":"changes: \"0000000000000000000000000000000000000000 6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 refs/heads/master\\n\""}1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.04 seconds)1987gitlab # [ 461.498544] gitaly[903]: time="2026-10-10T10:52:18.325Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:28.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:18.313" grpc.time_ms=11.296 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 461.512733] gitaly[903]: time="2026-10-10T10:52:18.342Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:52:28.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:18.331" grpc.time_ms=10.634 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab # [ 461.527170] nixbot[3889]: {"ts": "2026-10-10T10:52:18.365Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53482 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}1990gitlab # [ 461.556826] gitaly[903]: time="2026-10-10T10:52:18.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-10T10:52:28.102" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:18.412" grpc.time_ms=10.84 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 461.608794] gitaly[903]: time="2026-10-10T10:52:18.475Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:18.474" grpc.time_ms=0.552 pid=903 span.kind=server system=grpc1992gitlab # [ 461.641990] gitaly[903]: time="2026-10-10T10:52:18.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:18.507" grpc.time_ms=0.72 pid=903 span.kind=server system=grpc1993gitlab # [ 461.655856] gitaly[903]: time="2026-10-10T10:52:18.522Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA diskcache=0253ea3b-b73c-43ba-8e75-ffdfb8cbf75e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:52:28.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:18.440" pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1994gitlab # [ 461.669071] gitaly[903]: time="2026-10-10T10:52:18.523Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5222 command.oublock=8 command.real_time_ms=77 command.spawn_token_fork_ms=1 command.system_time_ms=43 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:52:28.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:18.440" grpc.time_ms=82.719 pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1995gitlab # [ 461.684844] gitaly[903]: time="2026-10-10T10:52:18.544Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-10T10:52:28.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:18.543" grpc.time_ms=0.232 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 461.701708] gitaly[903]: time="2026-10-10T10:52:18.568Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-10T10:52:28.241" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:18.551" grpc.time_ms=16.741 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 461.825769] gitaly[903]: time="2026-10-10T10:52:18.692Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-10T10:52:48.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:18.684" grpc.time_ms=8.021 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 461.866667] gitaly[903]: time="2026-10-10T10:52:18.733Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-10T10:52:28.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:18.732" grpc.time_ms=0.405 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 461.884723] gitaly[903]: time="2026-10-10T10:52:18.744Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-10T10:52:28.006" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-10T10:52:18.736" grpc.time_ms=8.038 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 461.909744] gitaly[903]: time="2026-10-10T10:52:18.776Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:28.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:18.765" grpc.time_ms=10.471 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 461.930107] gitaly[903]: time="2026-10-10T10:52:18.794Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:28.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:18.784" grpc.time_ms=9.943 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 461.959920] gitaly[903]: time="2026-10-10T10:52:18.826Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-10T10:52:48.210" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:18.810" grpc.time_ms=16.04 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2004gitlab # [ 462.506632] gitaly[903]: time="2026-10-10T10:52:19.372Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-10T10:52:29.060" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:19.370" grpc.time_ms=1.7 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.07 seconds)2006gitlab # [ 462.545450] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.410Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"cacc0353d916781b66cdf576","created_at":"2026-10-10T10:50:46.778Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-27cd1468a8b24c23","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:50:46.786Z","job_size_bytes":185,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-cacc0353d916781b66cdf576: done: 1.153968 sec","job_status":"done","queue_duration_s":91.470249,"scheduling_latency_s":91.470273,"gitaly_calls":13,"gitaly_duration_s":0.234138,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.046191,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.004214,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006147,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001815,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004193,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.017943,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011879,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.065,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.285,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.318,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.065,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.824466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081328,"exclusive_lock_hold_duration_s":0.0326175,"duration_s":1.153968,"completed_at":"2026-10-10T10:52:19.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.111213,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2007gitlab # [ 462.625175] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.413Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3c2942e6dc24f2d767865a5a","created_at":"2026-10-10T10:50:52.076Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.088Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3c2942e6dc24f2d767865a5a: start","job_status":"start","queue_duration_s":87.32512,"scheduling_latency_s":87.325148}2008gitlab # [ 462.645670] nixbot[3889]: {"ts": "2026-10-10T10:52:19.429Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53484 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2009gitlab # [ 462.648763] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.513Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3c2942e6dc24f2d767865a5a","created_at":"2026-10-10T10:50:52.076Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.088Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3c2942e6dc24f2d767865a5a: done: 0.099825 sec","job_status":"done","queue_duration_s":87.32512,"scheduling_latency_s":87.325148,"redis_calls":16,"redis_duration_s":0.004187000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002138,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027364,"duration_s":0.099825,"completed_at":"2026-10-10T10:52:19.513Z","load_balancing_strategy":"primary","db_duration_s":0.025941,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2010gitlab # [ 462.696715] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.515Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"67b7d990bc98efc724abb285","created_at":"2026-10-10T10:50:52.089Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.099Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-67b7d990bc98efc724abb285: start","job_status":"start","queue_duration_s":87.415751,"scheduling_latency_s":87.415774}2011gitlab # [ 462.754783] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.621Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"67b7d990bc98efc724abb285","created_at":"2026-10-10T10:50:52.089Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.099Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-67b7d990bc98efc724abb285: done: 0.105974 sec","job_status":"done","queue_duration_s":87.415751,"scheduling_latency_s":87.415774,"redis_calls":21,"redis_duration_s":0.00425,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001783,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026686,"duration_s":0.105974,"completed_at":"2026-10-10T10:52:19.621Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 462.810570] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:19.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"107025714e144dbd305332d5","created_at":"2026-10-10T10:50:52.267Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.275Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-107025714e144dbd305332d5: start","job_status":"start","queue_duration_s":87.346995,"scheduling_latency_s":87.347015}2013gitlab # [ 463.097727] gitaly[903]: time="2026-10-10T10:52:19.964Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:19.962" grpc.time_ms=1.493 pid=903 span.kind=server system=grpc2014gitlab # [ 463.132536] gitaly[903]: time="2026-10-10T10:52:19.999Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:19.998" grpc.time_ms=0.719 pid=903 span.kind=server system=grpc2015gitlab # [ 463.165800] gitaly[903]: time="2026-10-10T10:52:20.032Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:20.031" grpc.time_ms=0.577 pid=903 span.kind=server system=grpc2016gitlab # [ 463.181846] gitaly[903]: time="2026-10-10T10:52:20.046Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H diskcache=1fc21c8c-7527-4c38-9fc9-698b91a2b36b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-10T10:52:49.326" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:19.926" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 463.197868] gitaly[903]: time="2026-10-10T10:52:20.047Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7583 command.oublock=0 command.real_time_ms=114 command.spawn_token_fork_ms=0 command.system_time_ms=59 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-10T10:52:49.326" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:19.926" grpc.time_ms=119.849 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 463.371243] gitaly[903]: time="2026-10-10T10:52:20.237Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-10T10:52:50.036" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.236" grpc.time_ms=1.246 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 463.423839] gitaly[903]: time="2026-10-10T10:52:20.290Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZR7NFMR5S8R7JYQNDW5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:50.088" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.289" grpc.time_ms=1.034 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 463.450489] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.316Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"107025714e144dbd305332d5","created_at":"2026-10-10T10:50:52.267Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-512705e2332d4cfb","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:50:52.275Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-107025714e144dbd305332d5: done: 0.694039 sec","job_status":"done","queue_duration_s":87.346995,"scheduling_latency_s":87.347015,"gitaly_calls":3,"gitaly_duration_s":0.131405,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.032708,"redis_read_bytes":455,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001577,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002208,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011054,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.004981,"redis_queues_read_bytes":34,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.006998,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000819,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001049,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002445,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.025,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.03,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.476868,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4882728,"duration_s":0.694039,"completed_at":"2026-10-10T10:52:20.316Z","load_balancing_strategy":"primary","db_duration_s":0.080054,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2021gitlab # [ 463.531869] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.319Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 37d46a43d8f3655e89a5fd47e7094252142c2170 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4f0a9fba09b6ffbe61aafedd","created_at":"2026-10-10T10:52:15.984Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-d69e1e927ca94e48","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:15.993Z","job_size_bytes":185,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4f0a9fba09b6ffbe61aafedd: start","job_status":"start","queue_duration_s":4.325962,"scheduling_latency_s":4.325993}2022gitlab # [ 463.551755] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.337Z","message":"changes: \"6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 37d46a43d8f3655e89a5fd47e7094252142c2170 refs/heads/master\\n\""}2023gitlab # [ 463.554782] gitaly[903]: time="2026-10-10T10:52:20.375Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:30.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:20.363" grpc.time_ms=11.392 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2025gitlab # [ 463.568669] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.400Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1b4c3cb3cbec62286f1ca31c","created_at":"2026-10-10T10:52:20.396Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"2a30d923830743d25e5047a5","job_size_bytes":46,"pid":3767,"job_status":"deduplicated","message":"ProjectCacheWorker JID-1b4c3cb3cbec62286f1ca31c: deduplicated: until executing","deduplication.type":"until executing"}2026gitlab # [ 463.583856] gitaly[903]: time="2026-10-10T10:52:20.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-10T10:52:30.071" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:20.382" grpc.time_ms=10.682 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 463.598039] gitaly[903]: time="2026-10-10T10:52:20.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-10T10:52:30.111" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:20.422" grpc.time_ms=10.66 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 463.612126] gitaly[903]: time="2026-10-10T10:52:20.451Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-10T10:52:50.237" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.438" grpc.time_ms=12.638 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.06 seconds)2030gitlab # [ 463.628550] gitaly[903]: time="2026-10-10T10:52:20.475Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-10T10:52:30.158" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-10T10:52:20.468" grpc.time_ms=6.771 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 463.642738] nixbot[3889]: {"ts": "2026-10-10T10:52:20.480Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53488 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2032gitlab # [ 463.645772] gitaly[903]: time="2026-10-10T10:52:20.498Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:30.177" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:20.487" grpc.time_ms=10.251 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 463.780492] gitaly[903]: time="2026-10-10T10:52:20.647Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-10T10:52:30.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.645" grpc.time_ms=1.892 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 463.816984] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.683Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 37d46a43d8f3655e89a5fd47e7094252142c2170 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4f0a9fba09b6ffbe61aafedd","created_at":"2026-10-10T10:52:15.984Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-d69e1e927ca94e48","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:15.993Z","job_size_bytes":185,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4f0a9fba09b6ffbe61aafedd: done: 0.363812 sec","job_status":"done","queue_duration_s":4.325962,"scheduling_latency_s":4.325993,"gitaly_calls":7,"gitaly_duration_s":0.085482,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.028754000000000002,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.002825,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001333,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005099,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008786,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.010711,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.037,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.037,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.245162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102814,"exclusive_lock_hold_duration_s":0.02586594,"duration_s":0.363812,"completed_at":"2026-10-10T10:52:20.682Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034722,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2035gitlab # [ 463.887580] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.685Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2a30d923830743d25e5047a5","created_at":"2026-10-10T10:52:18.346Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.372Z","job_size_bytes":46,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2a30d923830743d25e5047a5: start","job_status":"start","queue_duration_s":2.312187,"scheduling_latency_s":2.31222}2036gitlab # [ 463.906714] gitaly[903]: time="2026-10-10T10:52:20.760Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-10T16:52:20.752" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:20.753" grpc.time_ms=6.027 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 463.918585] gitaly[903]: time="2026-10-10T10:52:20.781Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-10T10:52:50.168" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.769" grpc.time_ms=11.46 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 463.947720] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.814Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2a30d923830743d25e5047a5","created_at":"2026-10-10T10:52:18.346Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.372Z","job_size_bytes":46,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2a30d923830743d25e5047a5: done: 0.128913 sec","job_status":"done","queue_duration_s":2.312187,"scheduling_latency_s":2.31222,"gitaly_calls":2,"gitaly_duration_s":0.024095,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006599,"redis_read_bytes":69,"redis_write_bytes":4882,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00124,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000517,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001479,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002682,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000681,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027358,"duration_s":0.128913,"completed_at":"2026-10-10T10:52:20.813Z","load_balancing_strategy":"primary","db_duration_s":0.014374,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2039gitlab # [ 464.001244] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.815Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ab3f482138fbe600bca40b7d","created_at":"2026-10-10T10:52:18.398Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.406Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ab3f482138fbe600bca40b7d: start","job_status":"start","queue_duration_s":2.409122,"scheduling_latency_s":2.409143}2040gitlab # [ 464.020187] gitaly[903]: time="2026-10-10T10:52:20.869Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA diskcache=7704fff0-b1a2-4b43-b21d-4a82a043b34f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-10T16:52:20.842" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.843" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 464.030998] gitaly[903]: time="2026-10-10T10:52:20.870Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-10T16:52:20.842" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.843" grpc.time_ms=26.724 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 464.058812] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.925Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ab3f482138fbe600bca40b7d","created_at":"2026-10-10T10:52:18.398Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.406Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ab3f482138fbe600bca40b7d: done: 0.109337 sec","job_status":"done","queue_duration_s":2.409122,"scheduling_latency_s":2.409143,"gitaly_calls":1,"gitaly_duration_s":0.030075,"redis_calls":15,"redis_duration_s":0.0031980000000000003,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000364,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000495,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07949374,"duration_s":0.109337,"completed_at":"2026-10-10T10:52:20.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2043gitlab # [ 464.110209] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.927Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1f8bb037a2397a6a01028037","created_at":"2026-10-10T10:52:18.536Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.539Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1f8bb037a2397a6a01028037: start","job_status":"start","queue_duration_s":2.3874,"scheduling_latency_s":2.387428}2044gitlab # [ 464.126877] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.991Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1f8bb037a2397a6a01028037","created_at":"2026-10-10T10:52:18.536Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:18.539Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1f8bb037a2397a6a01028037: done: 0.064517 sec","job_status":"done","queue_duration_s":2.3874,"scheduling_latency_s":2.387428,"gitaly_calls":1,"gitaly_duration_s":0.014768,"redis_calls":16,"redis_duration_s":0.003784,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000321,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001572,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064517,"completed_at":"2026-10-10T10:52:20.991Z","load_balancing_strategy":"primary","db_duration_s":0.003749,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2045gitlab # [ 464.174620] gitaly[903]: time="2026-10-10T10:52:20.978Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-10T10:52:50.365" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:20.966" grpc.time_ms=11.626 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 464.188357] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:20.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e38a1182f8f55eca0293af8b","created_at":"2026-10-10T10:52:19.173Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36ed27644b210304c2c07b14e9b24e0bb9f5f6f1e2bc7ea6d2b483ebb52e265a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.180Z","job_size_bytes":467,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e38a1182f8f55eca0293af8b: start","job_status":"start","queue_duration_s":1.813337,"scheduling_latency_s":1.813366}2047gitlab # [ 464.206285] gitaly[903]: time="2026-10-10T10:52:21.027Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:51.026" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:21.026" grpc.time_ms=0.725 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 464.219341] gitaly[903]: time="2026-10-10T10:52:21.041Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-10T10:52:31.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:21.030" grpc.time_ms=10.474 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 464.311627] gitaly[903]: time="2026-10-10T10:52:21.178Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-10T10:52:51.176" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:21.177" grpc.time_ms=1.152 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 464.332821] gitaly[903]: time="2026-10-10T10:52:21.187Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=47 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-10T10:52:51.184" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:21.184" grpc.time_ms=3.028 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 464.451445] gitaly[903]: time="2026-10-10T10:52:21.318Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:31.285" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:21.305" grpc.time_ms=11.963 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.04 seconds)2054gitlab # [ 464.668979] nixbot[3889]: {"ts": "2026-10-10T10:52:21.534Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53492 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2055gitlab # [ 465.074959] gitaly[903]: time="2026-10-10T10:52:21.941Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-10T10:52:51.721" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:21.921" grpc.time_ms=18.994 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 465.100721] gitaly[903]: time="2026-10-10T10:52:21.963Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JPZJVGXFZSDE5J3Z4PPNGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-10T10:52:51.744" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:21.944" grpc.time_ms=18.381 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 465.132755] sidekiq-cluster[3767]: {"severity":"WARN","time":"2026-10-10T10:52:21.998Z","class":"CreatePipelineWorker","correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"6517f7ca3a65df2a6b8df0ed7f5b05aa09627135","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"6517f7ca3a65df2a6b8df0ed7f5b05aa09627135","ref":"refs/heads/master"},"retry":0}2058gitlab # [ 465.144619] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e38a1182f8f55eca0293af8b","created_at":"2026-10-10T10:52:19.173Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:36ed27644b210304c2c07b14e9b24e0bb9f5f6f1e2bc7ea6d2b483ebb52e265a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.180Z","job_size_bytes":467,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e38a1182f8f55eca0293af8b: done: 1.013143 sec","job_status":"done","queue_duration_s":1.813337,"scheduling_latency_s":1.813366,"gitaly_calls":7,"gitaly_duration_s":0.084611,"redis_calls":51,"redis_duration_s":0.010949,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000983,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004601,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003062,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.868959,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030624,"duration_s":1.013143,"completed_at":"2026-10-10T10:52:22.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066883,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2059gitlab # [ 465.211691] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.008Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"229d6432-1d9b-4d24-a2c9-b42ccc4b46a8\"}"],"class":"WebHookWorker","jid":"71278c0b6466cb22fc7c92f9","created_at":"2026-10-10T10:52:19.328Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73387d92d60197d8e77c08ba8bc966dcc5c78f41fc4306d7e97d4e1c88eea89f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.336Z","job_size_bytes":1751,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-71278c0b6466cb22fc7c92f9: start","job_status":"start","queue_duration_s":2.67198,"scheduling_latency_s":2.672003}2060gitlab # [ 465.329399] nixbot[3889]: {"ts": "2026-10-10T10:52:22.195Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "89e43d2e-f403-4d07-8704-5942228d099c", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "6517f7ca3a65df2a6b8df0ed7f5b05aa09627135", "pr": null}2061gitlab # [ 465.337432] nixbot[3889]: {"ts": "2026-10-10T10:52:22.204Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53500 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2062gitlab # [ 465.370412] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.235Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"229d6432-1d9b-4d24-a2c9-b42ccc4b46a8\"}"],"class":"WebHookWorker","jid":"71278c0b6466cb22fc7c92f9","created_at":"2026-10-10T10:52:19.328Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-2de2248f827c4c0c","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73387d92d60197d8e77c08ba8bc966dcc5c78f41fc4306d7e97d4e1c88eea89f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.336Z","job_size_bytes":1751,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-71278c0b6466cb22fc7c92f9: done: 0.226733 sec","job_status":"done","queue_duration_s":2.67198,"scheduling_latency_s":2.672003,"redis_calls":19,"redis_duration_s":0.006091,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001372,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00045,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002793,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001476,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.07100200000002133,"cpu_s":0.137973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088838,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.226733,"completed_at":"2026-10-10T10:52:22.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 465.450823] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a52714807070900e72292a8f","created_at":"2026-10-10T10:52:19.902Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.910Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a52714807070900e72292a8f: start","job_status":"start","queue_duration_s":2.328727,"scheduling_latency_s":2.328768}2064gitlab # [ 465.472938] gitaly[903]: time="2026-10-10T10:52:22.317Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2GTW6P9YZV3N1HPW3CC7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.304" grpc.time_ms=12.489 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 465.488707] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 812066gitlab # [ 465.517884] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a52714807070900e72292a8f","created_at":"2026-10-10T10:52:19.902Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:19.910Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a52714807070900e72292a8f: done: 0.145153 sec","job_status":"done","queue_duration_s":2.328727,"scheduling_latency_s":2.328768,"redis_calls":10,"redis_duration_s":0.003222,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048508,"duration_s":0.145153,"completed_at":"2026-10-10T10:52:22.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032875,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2067gitlab # [ 465.585201] gitaly[903]: time="2026-10-10T10:52:22.402Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2GXFV7Y3MD138TYNXSG1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.391" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2068gitlab # [ 465.596905] gitlab-workhorse[819]: time="2026-10-10T10:52:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672069gitlab # [ 465.598955] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 832070gitlab # [ 465.601197] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.386Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7ee36a4a6d832f9d31d2515f","created_at":"2026-10-10T10:52:20.055Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.065Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7ee36a4a6d832f9d31d2515f: start","job_status":"start","queue_duration_s":2.320752,"scheduling_latency_s":2.320783}2071gitlab # [ 465.619240] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.449Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7ee36a4a6d832f9d31d2515f","created_at":"2026-10-10T10:52:20.055Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.065Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7ee36a4a6d832f9d31d2515f: done: 0.063453 sec","job_status":"done","queue_duration_s":2.320752,"scheduling_latency_s":2.320783,"redis_calls":10,"redis_duration_s":0.003999,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037078,"duration_s":0.063453,"completed_at":"2026-10-10T10:52:22.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2073gitlab # [ 465.669283] gitaly[903]: time="2026-10-10T10:52:22.402Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2GXFV7Y3MD138TYNXSG1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.391" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2074gitlab # [ 465.683006] gitlab-workhorse[819]: time="2026-10-10T10:52:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3362075gitlab # [ 465.685062] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 942076gitlab # [ 465.687231] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bde114a3a1725e32c5e0093","created_at":"2026-10-10T10:52:20.088Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.099Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bde114a3a1725e32c5e0093: start","job_status":"start","queue_duration_s":2.351909,"scheduling_latency_s":2.35194}2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.05 seconds)2078gitlab # [ 465.705593] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2bde114a3a1725e32c5e0093","created_at":"2026-10-10T10:52:20.088Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.099Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2bde114a3a1725e32c5e0093: done: 0.068153 sec","job_status":"done","queue_duration_s":2.351909,"scheduling_latency_s":2.35194,"redis_calls":10,"redis_duration_s":0.003579,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058844,"duration_s":0.068153,"completed_at":"2026-10-10T10:52:22.519Z","load_balancing_strategy":"primary","db_duration_s":0.010635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 465.756917] gitaly[903]: time="2026-10-10T10:52:22.403Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2GXFV7Y3MD138TYNXSG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.391" grpc.time_ms=11.541 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2080gitlab # [ 465.773624] nixbot[3889]: {"ts": "2026-10-10T10:52:22.545Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2081gitlab # [ 465.776492] nixbot[3889]: {"ts": "2026-10-10T10:52:22.548Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "6517f7ca3a65df2a6b8df0ed7f5b05aa09627135"}2082gitlab # [ 465.779088] nixbot[3889]: {"ts": "2026-10-10T10:52:22.578Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53504 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2083gitlab # [ 465.782158] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4d8c8d1c6bb9704ba6f4c79a","created_at":"2026-10-10T10:52:20.125Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.135Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4d8c8d1c6bb9704ba6f4c79a: start","job_status":"start","queue_duration_s":2.386134,"scheduling_latency_s":2.386153}2084gitlab # [ 465.798588] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.586Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4d8c8d1c6bb9704ba6f4c79a","created_at":"2026-10-10T10:52:20.125Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.135Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4d8c8d1c6bb9704ba6f4c79a: done: 0.064296 sec","job_status":"done","queue_duration_s":2.386134,"scheduling_latency_s":2.386153,"redis_calls":13,"redis_duration_s":0.003778,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000888,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030148,"duration_s":0.064296,"completed_at":"2026-10-10T10:52:22.586Z","load_balancing_strategy":"primary","db_duration_s":0.013389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 465.846361] gitaly[903]: time="2026-10-10T10:52:22.499Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H0649GAH3K1T7AMCQES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.478" pid=903 remote_ip="2001:db8:1::1" request_sha=356697766eb4d0578df63710ab3bcad042589f07 response_bytes=336 span.kind=server system=grpc2086gitlab # [ 465.857268] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.588Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8c2bbe95dbe5732485e6768e","created_at":"2026-10-10T10:52:20.136Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.145Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8c2bbe95dbe5732485e6768e: start","job_status":"start","queue_duration_s":2.442735,"scheduling_latency_s":2.442762}2087gitlab # [ 465.874882] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.648Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8c2bbe95dbe5732485e6768e","created_at":"2026-10-10T10:52:20.136Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.145Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8c2bbe95dbe5732485e6768e: done: 0.060085 sec","job_status":"done","queue_duration_s":2.442735,"scheduling_latency_s":2.442762,"redis_calls":10,"redis_duration_s":0.003726,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000628,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005964,"duration_s":0.060085,"completed_at":"2026-10-10T10:52:22.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 465.922225] gitaly[903]: time="2026-10-10T10:52:22.499Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H0649GAH3K1T7AMCQES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.478" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2089gitlab # [ 465.936791] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cb88cd0a901fef942fc715a6","created_at":"2026-10-10T10:52:20.146Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.157Z","job_size_bytes":19,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cb88cd0a901fef942fc715a6: start","job_status":"start","queue_duration_s":2.493191,"scheduling_latency_s":2.49322}2090gitlab # [ 465.955015] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cb88cd0a901fef942fc715a6","created_at":"2026-10-10T10:52:20.146Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.157Z","job_size_bytes":19,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cb88cd0a901fef942fc715a6: done: 0.048637 sec","job_status":"done","queue_duration_s":2.493191,"scheduling_latency_s":2.49322,"redis_calls":11,"redis_duration_s":0.002863,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033126,"duration_s":0.048637,"completed_at":"2026-10-10T10:52:22.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2091gitlab # [ 466.002364] gitaly[903]: time="2026-10-10T10:52:22.499Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H0649GAH3K1T7AMCQES grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:22.478" grpc.time_ms=21.257 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2092gitlab # [ 466.018219] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2772093gitlab # [ 466.021071] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"92fbfd54a1f10adc31a7314c","created_at":"2026-10-10T10:52:20.161Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.169Z","job_size_bytes":66,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-92fbfd54a1f10adc31a7314c: start","job_status":"start","queue_duration_s":2.531288,"scheduling_latency_s":2.531315}2094gitlab # [ 466.039411] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.749Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"92fbfd54a1f10adc31a7314c","created_at":"2026-10-10T10:52:20.161Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.169Z","job_size_bytes":66,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-92fbfd54a1f10adc31a7314c: done: 0.048313 sec","job_status":"done","queue_duration_s":2.531288,"scheduling_latency_s":2.531315,"redis_calls":10,"redis_duration_s":0.003075,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003672,"duration_s":0.048313,"completed_at":"2026-10-10T10:52:22.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 466.088127] gitaly[903]: time="2026-10-10T10:52:22.671Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:52.470" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:22.670" grpc.time_ms=0.719 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 466.101624] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"873c0e89528a6b046463c747","created_at":"2026-10-10T10:52:20.171Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.179Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-873c0e89528a6b046463c747: start","job_status":"start","queue_duration_s":2.572148,"scheduling_latency_s":2.572175}2097gitlab # [ 466.118559] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"873c0e89528a6b046463c747","created_at":"2026-10-10T10:52:20.171Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.179Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-873c0e89528a6b046463c747: done: 0.066187 sec","job_status":"done","queue_duration_s":2.572148,"scheduling_latency_s":2.572175,"redis_calls":10,"redis_duration_s":0.003166,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045308,"duration_s":0.066187,"completed_at":"2026-10-10T10:52:22.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 466.166521] gitaly[903]: time="2026-10-10T10:52:22.765Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:32.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:22.752" grpc.time_ms=12.922 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 466.181269] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.819Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53a95f847825ff6f83a43837","created_at":"2026-10-10T10:52:20.191Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.198Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53a95f847825ff6f83a43837: start","job_status":"start","queue_duration_s":2.621114,"scheduling_latency_s":2.621139}2100gitlab # [ 466.198543] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.863Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53a95f847825ff6f83a43837","created_at":"2026-10-10T10:52:20.191Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.198Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53a95f847825ff6f83a43837: done: 0.043558 sec","job_status":"done","queue_duration_s":2.621114,"scheduling_latency_s":2.621139,"redis_calls":10,"redis_duration_s":0.001982,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003411,"duration_s":0.043558,"completed_at":"2026-10-10T10:52:22.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 466.245810] gitaly[903]: time="2026-10-10T10:52:22.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2HE7Y0PX2Y5GM06ZRPBX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:52.716" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:22.917" grpc.time_ms=0.93 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 466.259344] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2132103gitlab # [ 466.262103] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.864Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"31eb1c31b009a9790de0a2e9","created_at":"2026-10-10T10:52:20.199Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.205Z","job_size_bytes":6,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-31eb1c31b009a9790de0a2e9: start","job_status":"start","queue_duration_s":2.658823,"scheduling_latency_s":2.658839}2104gitlab # [ 466.279259] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"31eb1c31b009a9790de0a2e9","created_at":"2026-10-10T10:52:20.199Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.205Z","job_size_bytes":6,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-31eb1c31b009a9790de0a2e9: done: 0.028796 sec","job_status":"done","queue_duration_s":2.658823,"scheduling_latency_s":2.658839,"redis_calls":10,"redis_duration_s":0.004176,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027802,"duration_s":0.028796,"completed_at":"2026-10-10T10:52:22.893Z","load_balancing_strategy":"primary","db_duration_s":0.00275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 466.326569] gitaly[903]: time="2026-10-10T10:52:22.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2HE7Y0PX2Y5GM06ZRPBX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:32.217" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:22.968" grpc.time_ms=9.023 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 466.341106] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dee4063a24a27c9525dd416c","created_at":"2026-10-10T10:52:20.207Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.211Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dee4063a24a27c9525dd416c: start","job_status":"start","queue_duration_s":2.683998,"scheduling_latency_s":2.684025}2107gitlab # [ 466.357463] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dee4063a24a27c9525dd416c","created_at":"2026-10-10T10:52:20.207Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.211Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dee4063a24a27c9525dd416c: done: 0.06381 sec","job_status":"done","queue_duration_s":2.683998,"scheduling_latency_s":2.684025,"redis_calls":10,"redis_duration_s":0.002686,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046262,"duration_s":0.06381,"completed_at":"2026-10-10T10:52:22.959Z","load_balancing_strategy":"primary","db_duration_s":0.011872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2108gitlab # [ 466.405286] gitaly[903]: time="2026-10-10T10:52:23.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2HN6T9W2K80YF0K10E7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:53.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.157" grpc.time_ms=2.339 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 466.419074] gitaly[903]: time="2026-10-10T10:52:23.235Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 diskcache=f112c430-6d7b-4592-824b-27a2cfdee746 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-10T16:52:23.222" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.223" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 466.429771] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:22.961Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"270ad768f42d6d651e8d4c41","created_at":"2026-10-10T10:52:20.218Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.222Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-270ad768f42d6d651e8d4c41: start","job_status":"start","queue_duration_s":2.738898,"scheduling_latency_s":2.738923}2111gitlab # [ 466.447003] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:23.194Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"270ad768f42d6d651e8d4c41","created_at":"2026-10-10T10:52:20.218Z","trace_propagation_headers":{"sentry-trace":"61aa321e7d9c4504a7af03e735901f41-1a7f0cfeea754e87","baggage":"sentry-trace_id=61aa321e7d9c4504a7af03e735901f41,sentry-release=Unknown"},"correlation_id":"01M4JPZR7NFMR5S8R7JYQNDW5H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.222Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-270ad768f42d6d651e8d4c41: done: 0.233233 sec","job_status":"done","queue_duration_s":2.738898,"scheduling_latency_s":2.738923,"redis_calls":14,"redis_duration_s":0.00636,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001374,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108868,"duration_s":0.233233,"completed_at":"2026-10-10T10:52:23.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2112gitlab # [ 466.494690] gitaly[903]: time="2026-10-10T10:52:23.235Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-10T16:52:23.222" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.223" grpc.time_ms=11.86 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 466.509374] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6517f7ca3a65df2a6b8df0ed7f5b05aa09627135 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2302114gitlab # [ 466.512324] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:23.198Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ccdce16704e9393eb890dcf6","created_at":"2026-10-10T10:52:20.411Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ab3f482138fbe600bca40b7d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.416Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ccdce16704e9393eb890dcf6: start","job_status":"start","queue_duration_s":2.781486,"scheduling_latency_s":2.781515}2115gitlab # [ 466.531029] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:23.258Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ccdce16704e9393eb890dcf6","created_at":"2026-10-10T10:52:20.411Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ab3f482138fbe600bca40b7d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.416Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ccdce16704e9393eb890dcf6: done: 0.060285 sec","job_status":"done","queue_duration_s":2.781486,"scheduling_latency_s":2.781515,"gitaly_calls":1,"gitaly_duration_s":0.015522,"redis_calls":12,"redis_duration_s":0.004130999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000606,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001308,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03517458,"duration_s":0.060285,"completed_at":"2026-10-10T10:52:23.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 466.581977] gitaly[903]: time="2026-10-10T10:52:23.245Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2HN6T9W2K80YF0K10E7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:33.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:23.232" grpc.time_ms=12.374 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 466.596670] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862118gitlab # [ 466.598928] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:23.260Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ac6458b267e784facd47828f","created_at":"2026-10-10T10:52:20.581Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:75222591f8bc0c734028fc1b3324a1c1737a1d745227da66b2c7e848cf924c4a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.585Z","job_size_bytes":467,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ac6458b267e784facd47828f: start","job_status":"start","queue_duration_s":2.674768,"scheduling_latency_s":2.674795}2119gitlab # [ 466.618244] gitaly[903]: time="2026-10-10T10:52:23.290Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:53.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.289" grpc.time_ms=0.788 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 466.631624] gitaly[903]: time="2026-10-10T10:52:23.304Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-10T10:52:33.272" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:23.293" grpc.time_ms=10.63 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 466.645753] gitaly[903]: time="2026-10-10T10:52:23.352Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-10T10:52:53.351" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.351" grpc.time_ms=1.181 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 466.659570] gitlab-workhorse[819]: time="2026-10-10T10:52:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672123gitlab # [ 466.661733] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 762124gitlab # [ 466.663922] gitaly[903]: time="2026-10-10T10:52:23.364Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=297 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-10T10:52:53.357" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.357" grpc.time_ms=6.415 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 466.682423] gitaly[903]: time="2026-10-10T10:52:23.416Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:33.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:23.406" grpc.time_ms=9.712 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 466.697538] gitaly[903]: time="2026-10-10T10:52:23.427Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2HXDDFQQGK5Y9ZJEM1ZV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:23.417" grpc.time_ms=9.488 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2128gitlab # [ 466.712614] gitaly[903]: time="2026-10-10T10:52:23.504Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2J053T2SS28V7S8QV4KM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:23.493" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2129gitlab # [ 466.723597] gitaly[903]: time="2026-10-10T10:52:23.505Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2J053T2SS28V7S8QV4KM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:23.493" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2130gitlab # [ 466.737236] gitaly[903]: time="2026-10-10T10:52:23.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2J053T2SS28V7S8QV4KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:23.493" grpc.time_ms=11.574 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2131gitlab # [ 466.765191] nixbot[3889]: {"ts": "2026-10-10T10:52:23.631Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53514 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.05 seconds)2133gitlab # [ 467.146693] gitaly[903]: time="2026-10-10T10:52:24.012Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-10T10:52:53.093" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:23.993" grpc.time_ms=18.817 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 467.172193] gitaly[903]: time="2026-10-10T10:52:24.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2A1S02AET2EQX7335HH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-10T10:52:54.016" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.016" grpc.time_ms=15.999 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 467.195067] sidekiq-cluster[3767]: {"severity":"WARN","time":"2026-10-10T10:52:24.048Z","class":"CreatePipelineWorker","correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"6517f7ca3a65df2a6b8df0ed7f5b05aa09627135","after":"37d46a43d8f3655e89a5fd47e7094252142c2170","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"37d46a43d8f3655e89a5fd47e7094252142c2170","ref":"refs/heads/master"},"retry":0}2136gitlab # [ 467.206712] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ac6458b267e784facd47828f","created_at":"2026-10-10T10:52:20.581Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:75222591f8bc0c734028fc1b3324a1c1737a1d745227da66b2c7e848cf924c4a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.585Z","job_size_bytes":467,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ac6458b267e784facd47828f: done: 0.794232 sec","job_status":"done","queue_duration_s":2.674768,"scheduling_latency_s":2.674795,"gitaly_calls":7,"gitaly_duration_s":0.084254,"redis_calls":33,"redis_duration_s":0.0065450000000000005,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00065,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003373,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.689859,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.794232,"completed_at":"2026-10-10T10:52:24.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02251,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2137gitlab # [ 467.275050] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.056Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"73bf7b68-9b30-4130-8b7c-1eb29024854e\"}"],"class":"WebHookWorker","jid":"fbd894a3cc16b78c62e6e9d5","created_at":"2026-10-10T10:52:20.615Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a410881370a60895141b2ca150a2629a3f9ffcb14bac331d4c3f88453eccf66e","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.619Z","job_size_bytes":1749,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fbd894a3cc16b78c62e6e9d5: start","job_status":"start","queue_duration_s":3.436965,"scheduling_latency_s":3.436993}2138gitlab # [ 467.295081] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.107Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"73bf7b68-9b30-4130-8b7c-1eb29024854e\"}"],"class":"WebHookWorker","jid":"fbd894a3cc16b78c62e6e9d5","created_at":"2026-10-10T10:52:20.615Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-ffe84f3272f64135","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a410881370a60895141b2ca150a2629a3f9ffcb14bac331d4c3f88453eccf66e","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.619Z","job_size_bytes":1749,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fbd894a3cc16b78c62e6e9d5: done: 0.050447 sec","job_status":"done","queue_duration_s":3.436965,"scheduling_latency_s":3.436993,"redis_calls":14,"redis_duration_s":0.003537,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000613,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001799,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.00965664000000288,"cpu_s":0.031972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.050447,"completed_at":"2026-10-10T10:52:24.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 467.346548] nixbot[3889]: {"ts": "2026-10-10T10:52:24.088Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "e25e8f59-417f-419b-9843-d9e27d7e72d0", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "37d46a43d8f3655e89a5fd47e7094252142c2170", "pr": null}2140gitlab # [ 467.350519] nixbot[3889]: {"ts": "2026-10-10T10:52:24.091Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53528 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2141gitlab # [ 467.352721] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 652142gitlab # [ 467.354910] gitaly[903]: time="2026-10-10T10:52:24.187Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2JNT10TG0QKMS6WTFDD2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.178" grpc.time_ms=9.296 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2143gitlab # [ 467.368919] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.112Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a3b79707cd5b4e2c0dde0836","created_at":"2026-10-10T10:52:20.794Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-be65ea7be1b9447a","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.800Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a3b79707cd5b4e2c0dde0836: start","job_status":"start","queue_duration_s":3.311897,"scheduling_latency_s":3.311926}2144gitlab # [ 467.385894] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a3b79707cd5b4e2c0dde0836","created_at":"2026-10-10T10:52:20.794Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-be65ea7be1b9447a","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:20.800Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a3b79707cd5b4e2c0dde0836: done: 0.077689 sec","job_status":"done","queue_duration_s":3.311897,"scheduling_latency_s":3.311926,"redis_calls":19,"redis_duration_s":0.005578,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001395,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000762,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002351,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011736080000000001,"duration_s":0.077689,"completed_at":"2026-10-10T10:52:24.190Z","load_balancing_strategy":"primary","db_duration_s":0.009232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 467.435369] gitaly[903]: time="2026-10-10T10:52:24.275Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JQXP6ENZ314A5CH9EH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.263" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2146gitlab # [ 467.446453] gitlab-workhorse[819]: time="2026-10-10T10:52:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672147gitlab # [ 467.448491] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 872148gitlab # [ 467.450557] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.193Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","71278c0b6466cb22fc7c92f9"],"class":"WebHooks::LogExecutionWorker","jid":"07a13bfc79a220ce43bb205c","created_at":"2026-10-10T10:52:22.209Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-b6c4860a8b9a40ae","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1b33eca063ad6e3395ef4792128c73d7cde1ff3eaf55a2a4124b6486dec20688","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:22.220Z","job_size_bytes":2592,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-07a13bfc79a220ce43bb205c: start","job_status":"start","queue_duration_s":1.972014,"scheduling_latency_s":1.972046}2149gitlab # [ 467.468911] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.270Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","71278c0b6466cb22fc7c92f9"],"class":"WebHooks::LogExecutionWorker","jid":"07a13bfc79a220ce43bb205c","created_at":"2026-10-10T10:52:22.209Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-b6c4860a8b9a40ae","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1b33eca063ad6e3395ef4792128c73d7cde1ff3eaf55a2a4124b6486dec20688","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:22.220Z","job_size_bytes":2592,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-07a13bfc79a220ce43bb205c: done: 0.077397 sec","job_status":"done","queue_duration_s":1.972014,"scheduling_latency_s":1.972046,"redis_calls":10,"redis_duration_s":0.009007000000000001,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002589,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003545,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00131228,"duration_s":0.077397,"completed_at":"2026-10-10T10:52:24.270Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 467.517375] gitaly[903]: time="2026-10-10T10:52:24.275Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JQXP6ENZ314A5CH9EH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.263" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2151gitlab # [ 467.532225] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.276Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b515503dc2864b18c4af60fa","created_at":"2026-10-10T10:52:22.822Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-ffbf6d20ce344e50","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:22.828Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b515503dc2864b18c4af60fa: start","job_status":"start","queue_duration_s":1.447875,"scheduling_latency_s":1.447913}2152gitlab # [ 467.549836] gitaly[903]: time="2026-10-10T10:52:24.276Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JQXP6ENZ314A5CH9EH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.263" grpc.time_ms=12.104 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2153gitlab # [ 467.565323] gitaly[903]: time="2026-10-10T10:52:24.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2JVY1C9S4593XW7JN0BH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.412" grpc.time_ms=13.523 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2154gitlab # [ 467.579602] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1092155gitlab # [ 467.581923] gitaly[903]: time="2026-10-10T10:52:24.441Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:24.440" grpc.time_ms=0.682 pid=903 span.kind=server system=grpc2156gitlab # [ 467.607997] gitaly[903]: time="2026-10-10T10:52:24.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:24.473" grpc.time_ms=0.556 pid=903 span.kind=server system=grpc2157gitlab # [ 467.644079] gitaly[903]: time="2026-10-10T10:52:24.510Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JZD9QK12BGAD8AW0G2H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.492" pid=903 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2158gitlab # [ 467.656573] gitaly[903]: time="2026-10-10T10:52:24.510Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JZD9QK12BGAD8AW0G2H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.492" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2159gitlab # [ 467.672095] gitlab-workhorse[819]: time="2026-10-10T10:52:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162160gitlab # [ 467.674107] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 822161gitlab # [ 467.676143] gitaly[903]: time="2026-10-10T10:52:24.511Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2JZD9QK12BGAD8AW0G2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-10T10:52:24.492" grpc.time_ms=18.088 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2162gitlab # [ 467.692559] gitaly[903]: time="2026-10-10T10:52:24.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:24.511" grpc.time_ms=0.387 pid=903 span.kind=server system=grpc2163gitlab # [ 467.703290] gitaly[903]: time="2026-10-10T10:52:24.522Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 diskcache=12150c42-d492-4b61-90f6-8878d7fd946f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-10T10:52:54.405" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:24.406" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 467.714372] gitaly[903]: time="2026-10-10T10:52:24.522Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7178 command.oublock=0 command.real_time_ms=110 command.spawn_token_fork_ms=1 command.system_time_ms=79 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-10T10:52:54.405" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:24.406" grpc.time_ms=115.891 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170'2166gitlab # [ 467.748684] gitaly[903]: time="2026-10-10T10:52:24.615Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-10T10:52:54.613" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.613" grpc.time_ms=1.214 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 467.769878] gitaly[903]: time="2026-10-10T10:52:24.629Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:54.427" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.628" grpc.time_ms=0.65 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 467.789532] gitaly[903]: time="2026-10-10T10:52:24.647Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-10T10:52:54.438" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:24.638" grpc.time_ms=8.828 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 467.808908] gitaly[903]: time="2026-10-10T10:52:24.664Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2H5C577KA5M0TA2DPF95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:54.662" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.663" grpc.time_ms=0.66 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170', in 0.06 seconds)2171(finished: subtest: push delivers the webhook, in 94.79 seconds)2172subtest: eval and build post commit statuses2173gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2174gitlab # [ 467.822371] gitaly[903]: time="2026-10-10T10:52:24.666Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:34.283" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:24.654" grpc.time_ms=12.09 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 467.838434] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.678Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b515503dc2864b18c4af60fa","created_at":"2026-10-10T10:52:22.822Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-ffbf6d20ce344e50","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:22.828Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3767,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b515503dc2864b18c4af60fa: rescheduled"}2176gitlab # [ 467.854849] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.688Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b515503dc2864b18c4af60fa","created_at":"2026-10-10T10:52:22.822Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-ffbf6d20ce344e50","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:22.828Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b515503dc2864b18c4af60fa: done: 0.412351 sec","job_status":"done","queue_duration_s":1.447875,"scheduling_latency_s":1.447913,"gitaly_calls":3,"gitaly_duration_s":0.129465,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.03513,"redis_read_bytes":148,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.005682,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001257,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.006051,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.009327,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.003054,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001878,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002199,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214171,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.34901406,"duration_s":0.412351,"completed_at":"2026-10-10T10:52:24.688Z","load_balancing_strategy":"primary","db_duration_s":0.047794,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2177gitlab # [ 467.910800] nixbot[3889]: {"ts": "2026-10-10T10:52:24.690Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:53534 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1\" 200"}2178gitlab # [ 467.913976] gitaly[903]: time="2026-10-10T10:52:24.709Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-10T10:52:34.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:24.709" grpc.time_ms=0.325 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 467.925660] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.691Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fbd894a3cc16b78c62e6e9d5"],"class":"WebHooks::LogExecutionWorker","jid":"5899678000b8fc5a2b838496","created_at":"2026-10-10T10:52:24.093Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-fb772ebdd5084afa","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0b659882f98957387bce1053bad0e82c43a934d5fba79525c158585dd24deb66","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.097Z","job_size_bytes":2592,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5899678000b8fc5a2b838496: start","job_status":"start","queue_duration_s":0.593622,"scheduling_latency_s":0.593657}2180gitlab # [ 467.944257] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.732Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fbd894a3cc16b78c62e6e9d5"],"class":"WebHooks::LogExecutionWorker","jid":"5899678000b8fc5a2b838496","created_at":"2026-10-10T10:52:24.093Z","trace_propagation_headers":{"sentry-trace":"43f27337f90f4442a7a68a9156934aa0-fb772ebdd5084afa","baggage":"sentry-trace_id=43f27337f90f4442a7a68a9156934aa0,sentry-release=Unknown"},"correlation_id":"01M4JQ2A1S02AET2EQX7335HH4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0b659882f98957387bce1053bad0e82c43a934d5fba79525c158585dd24deb66","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.097Z","job_size_bytes":2592,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5899678000b8fc5a2b838496: done: 0.041255 sec","job_status":"done","queue_duration_s":0.593622,"scheduling_latency_s":0.593657,"redis_calls":7,"redis_duration_s":0.001877,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041255,"completed_at":"2026-10-10T10:52:24.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 467.992583] gitaly[903]: time="2026-10-10T10:52:24.728Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-10T10:52:34.015" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:24.715" grpc.time_ms=12.2 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 468.007612] gitaly[903]: time="2026-10-10T10:52:24.794Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:24.793" grpc.time_ms=0.455 pid=903 span.kind=server system=grpc2183gitlab # [ 468.019087] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1dd1866de12b6111151e6ab9","created_at":"2026-10-10T10:52:24.168Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-f3ed03abcf084ca3","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.176Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1dd1866de12b6111151e6ab9: start","job_status":"start","queue_duration_s":0.558372,"scheduling_latency_s":0.558411}2184gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.23 seconds)2185gitlab # [ 468.038326] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1dd1866de12b6111151e6ab9","created_at":"2026-10-10T10:52:24.168Z","trace_propagation_headers":{"sentry-trace":"855af907b98c4c469ebc72c1e1a41f00-f3ed03abcf084ca3","baggage":"sentry-trace_id=855af907b98c4c469ebc72c1e1a41f00,sentry-release=Unknown"},"correlation_id":"01M4JPZJVGXFZSDE5J3Z4PPNGA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.176Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1dd1866de12b6111151e6ab9: done: 0.114177 sec","job_status":"done","queue_duration_s":0.558372,"scheduling_latency_s":0.558411,"redis_calls":11,"redis_duration_s":0.0025570000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035896,"duration_s":0.114177,"completed_at":"2026-10-10T10:52:24.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 468.088153] gitaly[903]: time="2026-10-10T10:52:24.823Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K8RHAWR456PCAN9PSQB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:54.619" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.820" grpc.time_ms=3.117 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 468.102475] gitaly[903]: time="2026-10-10T10:52:24.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-10T10:52:24.826" grpc.time_ms=0.49 pid=903 span.kind=server system=grpc2188gitlab # [ 468.113399] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1932189gitlab # [ 468.116408] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"75e0ef74dd5bb0099d4d4024","created_at":"2026-10-10T10:52:24.389Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.394Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-75e0ef74dd5bb0099d4d4024: start","job_status":"start","queue_duration_s":0.455959,"scheduling_latency_s":0.455994}2190gitlab # [ 468.135158] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.917Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"75e0ef74dd5bb0099d4d4024","created_at":"2026-10-10T10:52:24.389Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.394Z","job_size_bytes":23,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-75e0ef74dd5bb0099d4d4024: done: 0.067076 sec","job_status":"done","queue_duration_s":0.455959,"scheduling_latency_s":0.455994,"redis_calls":7,"redis_duration_s":0.002005,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067076,"completed_at":"2026-10-10T10:52:24.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015437,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2191gitlab # [ 468.181135] gitaly[903]: time="2026-10-10T10:52:24.836Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X diskcache=fcf45aac-c0f8-4efa-acc7-ae455226d1ab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:52:34.031" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:24.731" pid=903 ref=refs/keep-around/37d46a43d8f3655e89a5fd47e7094252142c2170 remote_ip="2001:db8:1::1" revision=37d46a43d8f3655e89a5fd47e7094252142c2170 span.kind=server system=grpc username=root2192gitlab # [ 468.193401] nixbot[3889]: {"ts": "2026-10-10T10:52:25.005Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-37d46a43d8f3-5"}2193gitlab # [ 468.196172] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.919Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bd96fa70f699a7cbaed60a15","created_at":"2026-10-10T10:52:24.530Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.537Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bd96fa70f699a7cbaed60a15: start","job_status":"start","queue_duration_s":0.381949,"scheduling_latency_s":0.381977}2194gitlab # [ 468.213747] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.952Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bd96fa70f699a7cbaed60a15","created_at":"2026-10-10T10:52:24.530Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.537Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bd96fa70f699a7cbaed60a15: done: 0.032986 sec","job_status":"done","queue_duration_s":0.381949,"scheduling_latency_s":0.381977,"redis_calls":7,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032986,"completed_at":"2026-10-10T10:52:24.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 468.259210] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4342196gitlab # [ 468.262023] gitaly[903]: time="2026-10-10T10:52:24.836Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5064 command.oublock=8 command.real_time_ms=96 command.spawn_token_fork_ms=2 command.system_time_ms=26 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-10T10:52:34.031" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-10T10:52:24.731" grpc.time_ms=104.594 pid=903 ref=refs/keep-around/37d46a43d8f3655e89a5fd47e7094252142c2170 remote_ip="2001:db8:1::1" revision=37d46a43d8f3655e89a5fd47e7094252142c2170 span.kind=server system=grpc username=root2197gitlab # [ 468.277662] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cfb8e2fb4e4f75a9f8b05ffa","created_at":"2026-10-10T10:52:24.549Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.553Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cfb8e2fb4e4f75a9f8b05ffa: start","job_status":"start","queue_duration_s":0.400413,"scheduling_latency_s":0.400441}2198gitlab # [ 468.295676] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cfb8e2fb4e4f75a9f8b05ffa","created_at":"2026-10-10T10:52:24.549Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.553Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cfb8e2fb4e4f75a9f8b05ffa: done: 0.039363 sec","job_status":"done","queue_duration_s":0.400413,"scheduling_latency_s":0.400441,"redis_calls":7,"redis_duration_s":0.003608,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039363,"completed_at":"2026-10-10T10:52:24.993Z","load_balancing_strategy":"primary","db_duration_s":0.006015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 468.340234] nixbot[3889]: {"ts": "2026-10-10T10:52:25.139Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-37d46a43d8f3-5", "argv0": "bwrap"}2200gitlab # [ 468.342736] gitaly[903]: time="2026-10-10T10:52:24.842Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:54.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:24.842" grpc.time_ms=0.42 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 468.356477] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:24.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b20f916ebd51e642055edeaf","created_at":"2026-10-10T10:52:24.568Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.572Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b20f916ebd51e642055edeaf: start","job_status":"start","queue_duration_s":0.422371,"scheduling_latency_s":0.4224}2202gitlab # [ 468.372788] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b20f916ebd51e642055edeaf","created_at":"2026-10-10T10:52:24.568Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.572Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b20f916ebd51e642055edeaf: done: 0.044414 sec","job_status":"done","queue_duration_s":0.422371,"scheduling_latency_s":0.4224,"redis_calls":10,"redis_duration_s":0.0047150000000000004,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003053,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044414,"completed_at":"2026-10-10T10:52:25.039Z","load_balancing_strategy":"primary","db_duration_s":0.006954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203gitlab # [ 468.418286] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.041Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0e09fe0299aff14ff0e788a1","created_at":"2026-10-10T10:52:24.573Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.576Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0e09fe0299aff14ff0e788a1: start","job_status":"start","queue_duration_s":0.464648,"scheduling_latency_s":0.464676}2204gitlab # [ 468.435907] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0e09fe0299aff14ff0e788a1","created_at":"2026-10-10T10:52:24.573Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.576Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0e09fe0299aff14ff0e788a1: done: 0.031123 sec","job_status":"done","queue_duration_s":0.464648,"scheduling_latency_s":0.464676,"redis_calls":7,"redis_duration_s":0.001442,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031123,"completed_at":"2026-10-10T10:52:25.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 468.481571] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.073Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9f8a819a34e85a86a7dd0998","created_at":"2026-10-10T10:52:24.577Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.581Z","job_size_bytes":19,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9f8a819a34e85a86a7dd0998: start","job_status":"start","queue_duration_s":0.492604,"scheduling_latency_s":0.492629}2206gitlab # [ 468.500282] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9f8a819a34e85a86a7dd0998","created_at":"2026-10-10T10:52:24.577Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.581Z","job_size_bytes":19,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9f8a819a34e85a86a7dd0998: done: 0.034736 sec","job_status":"done","queue_duration_s":0.492604,"scheduling_latency_s":0.492629,"redis_calls":8,"redis_duration_s":0.001836,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034736,"completed_at":"2026-10-10T10:52:25.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 468.545660] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.110Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"32ba6b3436ef3453f3714317","created_at":"2026-10-10T10:52:24.582Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.585Z","job_size_bytes":66,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-32ba6b3436ef3453f3714317: start","job_status":"start","queue_duration_s":0.524525,"scheduling_latency_s":0.524555}2208gitlab # [ 468.563900] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.153Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"32ba6b3436ef3453f3714317","created_at":"2026-10-10T10:52:24.582Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.585Z","job_size_bytes":66,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-32ba6b3436ef3453f3714317: done: 0.042892 sec","job_status":"done","queue_duration_s":0.524525,"scheduling_latency_s":0.524555,"redis_calls":7,"redis_duration_s":0.004195,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003537,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042892,"completed_at":"2026-10-10T10:52:25.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 468.610216] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.155Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"244b1377ff1b3ba15122940c","created_at":"2026-10-10T10:52:24.586Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.589Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-244b1377ff1b3ba15122940c: start","job_status":"start","queue_duration_s":0.565616,"scheduling_latency_s":0.565653}2210gitlab # [ 468.627961] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.198Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"244b1377ff1b3ba15122940c","created_at":"2026-10-10T10:52:24.586Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.589Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-244b1377ff1b3ba15122940c: done: 0.04286 sec","job_status":"done","queue_duration_s":0.565616,"scheduling_latency_s":0.565653,"redis_calls":7,"redis_duration_s":0.001983,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04286,"completed_at":"2026-10-10T10:52:25.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 468.674644] nix-daemon[4054]: accepted connection from pid 5150, user nixbot2212gitlab # [ 468.675746] gitaly[903]: time="2026-10-10T10:52:25.512Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-10T10:52:55.510" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:25.511" grpc.time_ms=1.046 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 468.689365] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"56768a2b587e4d9554d0fbae","created_at":"2026-10-10T10:52:24.590Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.593Z","job_size_bytes":6,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-56768a2b587e4d9554d0fbae: start","job_status":"start","queue_duration_s":0.606902,"scheduling_latency_s":0.606932}2214gitlab # [ 468.707795] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"56768a2b587e4d9554d0fbae","created_at":"2026-10-10T10:52:24.590Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.593Z","job_size_bytes":6,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-56768a2b587e4d9554d0fbae: done: 0.019523 sec","job_status":"done","queue_duration_s":0.606902,"scheduling_latency_s":0.606932,"redis_calls":7,"redis_duration_s":0.001626,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019523,"completed_at":"2026-10-10T10:52:25.219Z","load_balancing_strategy":"primary","db_duration_s":0.000609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 468.752444] gitaly[903]: time="2026-10-10T10:52:25.552Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2K3FE3ZS2GV6ECRP766X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:55.550" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:25.551" grpc.time_ms=0.976 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 468.765467] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"49fe28c1dcd61df4165b51b8","created_at":"2026-10-10T10:52:24.594Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.596Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-49fe28c1dcd61df4165b51b8: start","job_status":"start","queue_duration_s":0.624642,"scheduling_latency_s":0.624666}2217gitlab # [ 468.781429] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"49fe28c1dcd61df4165b51b8","created_at":"2026-10-10T10:52:24.594Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.596Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-49fe28c1dcd61df4165b51b8: done: 0.029859 sec","job_status":"done","queue_duration_s":0.624642,"scheduling_latency_s":0.624666,"redis_calls":7,"redis_duration_s":0.001599,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029859,"completed_at":"2026-10-10T10:52:25.251Z","load_balancing_strategy":"primary","db_duration_s":0.00427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 468.825522] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.253Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d635ec84d1ad42a2736ea03e","created_at":"2026-10-10T10:52:24.678Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.681Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d635ec84d1ad42a2736ea03e: start","job_status":"start","queue_duration_s":0.571302,"scheduling_latency_s":0.57133}2219gitlab # [ 468.842152] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.286Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d635ec84d1ad42a2736ea03e","created_at":"2026-10-10T10:52:24.678Z","trace_propagation_headers":{"sentry-trace":"494660000d7d418f9bc90c3ed4053006-b74b0c209f2949e0","baggage":"sentry-trace_id=494660000d7d418f9bc90c3ed4053006,sentry-release=Unknown"},"correlation_id":"01M4JQ2H5C577KA5M0TA2DPF95","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.681Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d635ec84d1ad42a2736ea03e: done: 0.033048 sec","job_status":"done","queue_duration_s":0.571302,"scheduling_latency_s":0.57133,"redis_calls":8,"redis_duration_s":0.002236,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001807,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033048,"completed_at":"2026-10-10T10:52:25.286Z","load_balancing_strategy":"primary","db_duration_s":0.004846,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2220gitlab # [ 468.886627] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.287Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"adb568ce918d95daeda11434","created_at":"2026-10-10T10:52:24.847Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.852Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-adb568ce918d95daeda11434: start","job_status":"start","queue_duration_s":0.434889,"scheduling_latency_s":0.434914}2221gitlab # [ 468.905659] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.323Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"adb568ce918d95daeda11434","created_at":"2026-10-10T10:52:24.847Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.852Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-adb568ce918d95daeda11434: done: 0.035992 sec","job_status":"done","queue_duration_s":0.434889,"scheduling_latency_s":0.434914,"redis_calls":7,"redis_duration_s":0.0017569999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035992,"completed_at":"2026-10-10T10:52:25.323Z","load_balancing_strategy":"primary","db_duration_s":0.006261,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2222gitlab # [ 468.951209] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.325Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2c5068149047868da61c21c8","created_at":"2026-10-10T10:52:24.854Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.859Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2c5068149047868da61c21c8: start","job_status":"start","queue_duration_s":0.465892,"scheduling_latency_s":0.465914}2223gitlab # [ 468.969752] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.417Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2c5068149047868da61c21c8","created_at":"2026-10-10T10:52:24.854Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.859Z","job_size_bytes":65,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2c5068149047868da61c21c8: done: 0.092489 sec","job_status":"done","queue_duration_s":0.465892,"scheduling_latency_s":0.465914,"redis_calls":10,"redis_duration_s":0.003644,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092489,"completed_at":"2026-10-10T10:52:25.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 469.016690] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.420Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"27f8c5a86b92f789173f7303","created_at":"2026-10-10T10:52:24.966Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.970Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27f8c5a86b92f789173f7303: start","job_status":"start","queue_duration_s":0.450097,"scheduling_latency_s":0.450128}2225gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2226gitlab # [ 469.033374] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.565Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"27f8c5a86b92f789173f7303","created_at":"2026-10-10T10:52:24.966Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-8a6e318ef7e54ba5","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:24.970Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27f8c5a86b92f789173f7303: done: 0.145789 sec","job_status":"done","queue_duration_s":0.450097,"scheduling_latency_s":0.450128,"gitaly_calls":2,"gitaly_duration_s":0.007436,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00768,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001061,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00117,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000276,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002185,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000254,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000562,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108313,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10514908,"duration_s":0.145789,"completed_at":"2026-10-10T10:52:25.565Z","load_balancing_strategy":"primary","db_duration_s":0.029866,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2227gitlab # [ 469.086339] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"430b2999bf7b40b2dd100f6a","created_at":"2026-10-10T10:52:25.493Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-bdae893adbd34177","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:25.496Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-430b2999bf7b40b2dd100f6a: start","job_status":"start","queue_duration_s":0.071456,"scheduling_latency_s":0.071481}2228gitlab # [ 469.103850] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:25.606Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"430b2999bf7b40b2dd100f6a","created_at":"2026-10-10T10:52:25.493Z","trace_propagation_headers":{"sentry-trace":"35c11e4f35a249988667dec39203a079-bdae893adbd34177","baggage":"sentry-trace_id=35c11e4f35a249988667dec39203a079,sentry-release=Unknown"},"correlation_id":"01M4JQ2K3FE3ZS2GV6ECRP766X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:25.496Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-430b2999bf7b40b2dd100f6a: done: 0.038332 sec","job_status":"done","queue_duration_s":0.071456,"scheduling_latency_s":0.071481,"redis_calls":7,"redis_duration_s":0.00163,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038332,"completed_at":"2026-10-10T10:52:25.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 469.191339] gitaly[903]: time="2026-10-10T10:52:26.057Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2MFT7JX5Y12BB7DQGBAT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:56.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:26.056" grpc.time_ms=0.838 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.17 seconds)2231gitlab # [ 469.231039] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1182232gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2233gitlab # [ 470.339806] gitaly[903]: time="2026-10-10T10:52:27.205Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2NM0GKBYT66WJRM7G7WB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:57.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:27.204" grpc.time_ms=0.977 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2234gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.14 seconds)2235gitlab # [ 470.374433] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1032236gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2237gitlab # [ 471.479837] gitaly[903]: time="2026-10-10T10:52:28.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2PQKMY64FVWSY3ATECZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:58.144" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:28.344" grpc.time_ms=0.891 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2238gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.14 seconds)2239gitlab # [ 471.514015] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1042240gitlab # [ 472.157948] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"18b8a3ddf660fbb349dcc1e0","created_at":"2026-10-10T10:52:29.004Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a919a5ba8e4d00fe900abb457dfee8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.021Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-18b8a3ddf660fbb349dcc1e0: start","job_status":"start","queue_duration_s":0.002136,"scheduling_latency_s":0.002176}2241gitlab # [ 472.358649] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"18b8a3ddf660fbb349dcc1e0","created_at":"2026-10-10T10:52:29.004Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a919a5ba8e4d00fe900abb457dfee8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.021Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-18b8a3ddf660fbb349dcc1e0: done: 0.200906 sec","job_status":"done","queue_duration_s":0.002136,"scheduling_latency_s":0.002176,"redis_calls":13,"redis_duration_s":0.016483,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006013,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00163826,"exclusive_lock_hold_duration_s":0.0983033,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.200906,"completed_at":"2026-10-10T10:52:29.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 472.432258] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e21c23ad6a4eaa86864203ca","created_at":"2026-10-10T10:52:29.049Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ac2844f600dac8b22bff8a3a04be670","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.064Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e21c23ad6a4eaa86864203ca: start","job_status":"start","queue_duration_s":0.179745,"scheduling_latency_s":0.179791}2243gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2244gitlab # [ 472.495430] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e21c23ad6a4eaa86864203ca","created_at":"2026-10-10T10:52:29.049Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ac2844f600dac8b22bff8a3a04be670","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.064Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e21c23ad6a4eaa86864203ca: done: 0.117117 sec","job_status":"done","queue_duration_s":0.179745,"scheduling_latency_s":0.179791,"redis_calls":11,"redis_duration_s":0.026827,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00252266,"exclusive_lock_hold_duration_s":0.01113588,"duration_s":0.117117,"completed_at":"2026-10-10T10:52:29.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 472.557841] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81bd01c612ba521b4aa4775b","created_at":"2026-10-10T10:52:29.078Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"855438001a714083c7d9fc036d13678f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.093Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81bd01c612ba521b4aa4775b: start","job_status":"start","queue_duration_s":0.276884,"scheduling_latency_s":0.276926}2246gitlab # [ 472.623773] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81bd01c612ba521b4aa4775b","created_at":"2026-10-10T10:52:29.078Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"855438001a714083c7d9fc036d13678f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.093Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81bd01c612ba521b4aa4775b: done: 0.119083 sec","job_status":"done","queue_duration_s":0.276884,"scheduling_latency_s":0.276926,"redis_calls":11,"redis_duration_s":0.035412,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.016725,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.119083,"completed_at":"2026-10-10T10:52:29.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 472.690260] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d095e58fe95de7ebcf978c21","created_at":"2026-10-10T10:52:29.138Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.176Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d095e58fe95de7ebcf978c21: start","job_status":"start","queue_duration_s":0.320475,"scheduling_latency_s":0.32052}2248gitlab # [ 472.774331] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d095e58fe95de7ebcf978c21","created_at":"2026-10-10T10:52:29.138Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.176Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d095e58fe95de7ebcf978c21: done: 0.142933 sec","job_status":"done","queue_duration_s":0.320475,"scheduling_latency_s":0.32052,"redis_calls":18,"redis_duration_s":0.008607,"redis_read_bytes":20,"redis_write_bytes":4690,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001169,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3007,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004815,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.142933,"completed_at":"2026-10-10T10:52:29.640Z","load_balancing_strategy":"primary","db_duration_s":0.012282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 472.824525] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0a59d5e120e11bde3302b539","created_at":"2026-10-10T10:52:29.197Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8c99c3bbcb890669c0c478023bf15d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:52:29.220Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0a59d5e120e11bde3302b539: start","job_status":"start","queue_duration_s":0.427256,"scheduling_latency_s":0.427298}2250gitlab # [ 472.848527] nix-daemon[4054]: accepted connection from pid 5188, user nixbot2251gitlab # [ 472.849721] nix-daemon[4054]: accepted connection from pid 5150, user nixbot2252gitlab # [ 472.851218] gitaly[903]: time="2026-10-10T10:52:29.675Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2QVNYYBZTPYWGAYWH8KW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:52:59.372" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:29.672" grpc.time_ms=2.228 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.35 seconds)2254gitlab # [ 472.868231] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2892255gitlab # [ 473.015209] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.881Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2256gitlab # [ 473.055306] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0a59d5e120e11bde3302b539","created_at":"2026-10-10T10:52:29.197Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8c99c3bbcb890669c0c478023bf15d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-10T10:52:29.220Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0a59d5e120e11bde3302b539: done: 0.273651 sec","job_status":"done","queue_duration_s":0.427256,"scheduling_latency_s":0.427298,"redis_calls":9,"redis_duration_s":0.211265,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.199218,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.273651,"completed_at":"2026-10-10T10:52:29.921Z","load_balancing_strategy":"primary","db_duration_s":0.003719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 473.122200] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:29.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2ebe332a7000438e124f769f","created_at":"2026-10-10T10:52:29.243Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.258Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2ebe332a7000438e124f769f: start","job_status":"start","queue_duration_s":0.67099,"scheduling_latency_s":0.671034}2258gitlab # [ 473.417466] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2ebe332a7000438e124f769f","created_at":"2026-10-10T10:52:29.243Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.258Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2ebe332a7000438e124f769f: done: 0.353729 sec","job_status":"done","queue_duration_s":0.67099,"scheduling_latency_s":0.671034,"redis_calls":70,"redis_duration_s":0.093138,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.019049,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000532,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.070508,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.168007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.353729,"completed_at":"2026-10-10T10:52:30.283Z","load_balancing_strategy":"primary","db_duration_s":0.014717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 473.489135] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.284Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3d1e5d3d325029fe7138df76","created_at":"2026-10-10T10:52:29.264Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4c5f7feadd5ee8f4eb810849564dd8b1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.287Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3d1e5d3d325029fe7138df76: start","job_status":"start","queue_duration_s":0.996916,"scheduling_latency_s":0.996942}2260gitlab # [ 473.506459] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.309Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3d1e5d3d325029fe7138df76","created_at":"2026-10-10T10:52:29.264Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4c5f7feadd5ee8f4eb810849564dd8b1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.287Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3d1e5d3d325029fe7138df76: done: 0.024382 sec","job_status":"done","queue_duration_s":0.996916,"scheduling_latency_s":0.996942,"redis_calls":9,"redis_duration_s":0.002204,"redis_read_bytes":7,"redis_write_bytes":1108,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024382,"completed_at":"2026-10-10T10:52:30.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 473.551685] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"922e661b6aeaf5f4eaddbfe5","created_at":"2026-10-10T10:52:29.308Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ae52d5b95ccc88c924d81f17765f4d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.332Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-922e661b6aeaf5f4eaddbfe5: start","job_status":"start","queue_duration_s":0.978213,"scheduling_latency_s":0.978239}2262gitlab # [ 473.567510] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.324Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2263gitlab # [ 473.571262] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"922e661b6aeaf5f4eaddbfe5","created_at":"2026-10-10T10:52:29.308Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ae52d5b95ccc88c924d81f17765f4d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.332Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-922e661b6aeaf5f4eaddbfe5: done: 0.025678 sec","job_status":"done","queue_duration_s":0.978213,"scheduling_latency_s":0.978239,"redis_calls":9,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025678,"completed_at":"2026-10-10T10:52:30.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2264gitlab # [ 473.617047] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4e009a30343052b4970ba898","created_at":"2026-10-10T10:52:29.352Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"836f15cefe82fc684c1a61cbd5cb5642","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.368Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4e009a30343052b4970ba898: start","job_status":"start","queue_duration_s":0.969673,"scheduling_latency_s":0.969698}2265gitlab # [ 473.632767] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4e009a30343052b4970ba898","created_at":"2026-10-10T10:52:29.352Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"836f15cefe82fc684c1a61cbd5cb5642","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.368Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4e009a30343052b4970ba898: done: 0.022813 sec","job_status":"done","queue_duration_s":0.969673,"scheduling_latency_s":0.969698,"redis_calls":9,"redis_duration_s":0.002025,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022813,"completed_at":"2026-10-10T10:52:30.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 473.680104] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8502f79866a61818844c709e","created_at":"2026-10-10T10:52:29.383Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84dfd96c17075910d67edfbc86cfb2cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.403Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8502f79866a61818844c709e: start","job_status":"start","queue_duration_s":0.958146,"scheduling_latency_s":0.958166}2267gitlab # [ 473.695316] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.375Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2268gitlab # [ 473.699251] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8502f79866a61818844c709e","created_at":"2026-10-10T10:52:29.383Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84dfd96c17075910d67edfbc86cfb2cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.403Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8502f79866a61818844c709e: done: 0.021349 sec","job_status":"done","queue_duration_s":0.958146,"scheduling_latency_s":0.958166,"redis_calls":9,"redis_duration_s":0.001677,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000371,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021349,"completed_at":"2026-10-10T10:52:30.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 473.744541] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f6d187f6f1c8b0e23a410752","created_at":"2026-10-10T10:52:29.427Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edeb98d24242d691603fad2d2e29d286","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.457Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f6d187f6f1c8b0e23a410752: start","job_status":"start","queue_duration_s":0.926896,"scheduling_latency_s":0.926917}2270gitlab # [ 473.759676] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f6d187f6f1c8b0e23a410752","created_at":"2026-10-10T10:52:29.427Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edeb98d24242d691603fad2d2e29d286","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.457Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f6d187f6f1c8b0e23a410752: done: 0.027706 sec","job_status":"done","queue_duration_s":0.926896,"scheduling_latency_s":0.926917,"redis_calls":11,"redis_duration_s":0.002787,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056182,"exclusive_lock_hold_duration_s":0.00459102,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027706,"completed_at":"2026-10-10T10:52:30.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 473.806015] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9adc4d598e7ae46aa22d403d","created_at":"2026-10-10T10:52:29.481Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9ae4bf04244db44a7c58e2896deabff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.500Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9adc4d598e7ae46aa22d403d: start","job_status":"start","queue_duration_s":0.913697,"scheduling_latency_s":0.91372}2272gitlab # [ 473.821051] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9adc4d598e7ae46aa22d403d","created_at":"2026-10-10T10:52:29.481Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9ae4bf04244db44a7c58e2896deabff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.500Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9adc4d598e7ae46aa22d403d: done: 0.034156 sec","job_status":"done","queue_duration_s":0.913697,"scheduling_latency_s":0.91372,"redis_calls":9,"redis_duration_s":0.002186,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034156,"completed_at":"2026-10-10T10:52:30.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2274gitlab # [ 473.866184] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"29795a3df6dc90800e87f4bf","created_at":"2026-10-10T10:52:29.536Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8591cef5ba1f54caf51bfd6a9deea15","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.559Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-29795a3df6dc90800e87f4bf: start","job_status":"start","queue_duration_s":0.889757,"scheduling_latency_s":0.889778}2275gitlab # [ 473.957065] gitaly[903]: time="2026-10-10T10:52:30.823Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2S5NC61PEQT6WGMNM388 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:00.621" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:30.822" grpc.time_ms=0.774 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.12 seconds)2277gitlab # [ 473.978283] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"29795a3df6dc90800e87f4bf","created_at":"2026-10-10T10:52:29.536Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8591cef5ba1f54caf51bfd6a9deea15","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.559Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-29795a3df6dc90800e87f4bf: done: 0.384381 sec","job_status":"done","queue_duration_s":0.889757,"scheduling_latency_s":0.889778,"redis_calls":564,"redis_duration_s":0.078172,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.076736,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.344961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.384381,"completed_at":"2026-10-10T10:52:30.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2278gitlab # [ 474.040986] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.836Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c2882796e53f6a1e83bbf747","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c2882796e53f6a1e83bbf747: start","job_status":"start","queue_duration_s":1.260424,"scheduling_latency_s":1.260454}2279gitlab # [ 474.062134] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.856Z","message":"No existing merge request to be cleaned up."}2280gitlab # [ 474.064957] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.871Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c2882796e53f6a1e83bbf747","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c2882796e53f6a1e83bbf747: done: 0.035242 sec","job_status":"done","queue_duration_s":1.260424,"scheduling_latency_s":1.260454,"redis_calls":12,"redis_duration_s":0.002398,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035242,"completed_at":"2026-10-10T10:52:30.871Z","load_balancing_strategy":"primary","db_duration_s":0.005031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 474.118552] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.873Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e3de5d60ab511097fb4c2de","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e3de5d60ab511097fb4c2de: start","job_status":"start","queue_duration_s":1.297093,"scheduling_latency_s":1.297117}2282gitlab # [ 474.131937] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.885Z","message":"No existing merge request to be cleaned up."}2283gitlab # [ 474.134200] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 802284gitlab # [ 474.137051] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.894Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e3de5d60ab511097fb4c2de","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e3de5d60ab511097fb4c2de: done: 0.021476 sec","job_status":"done","queue_duration_s":1.297093,"scheduling_latency_s":1.297117,"redis_calls":10,"redis_duration_s":0.001891,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021476,"completed_at":"2026-10-10T10:52:30.894Z","load_balancing_strategy":"primary","db_duration_s":0.001779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 474.177604] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.896Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"119b037c76729703c2cef4ed","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-119b037c76729703c2cef4ed: start","job_status":"start","queue_duration_s":1.319995,"scheduling_latency_s":1.320018}2286gitlab # [ 474.190617] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.908Z","message":"No existing merge request to be cleaned up."}2287gitlab # [ 474.192423] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.917Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"119b037c76729703c2cef4ed","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-119b037c76729703c2cef4ed: done: 0.021403 sec","job_status":"done","queue_duration_s":1.319995,"scheduling_latency_s":1.320018,"redis_calls":10,"redis_duration_s":0.001908,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021403,"completed_at":"2026-10-10T10:52:30.917Z","load_balancing_strategy":"primary","db_duration_s":0.002001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 474.232826] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"397f5c5fdbfa2cc82dbbdcc2","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-397f5c5fdbfa2cc82dbbdcc2: start","job_status":"start","queue_duration_s":1.342837,"scheduling_latency_s":1.342861}2289gitlab # [ 474.245673] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.930Z","message":"No existing merge request to be cleaned up."}2290gitlab # [ 474.247433] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.939Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"397f5c5fdbfa2cc82dbbdcc2","created_at":"2026-10-10T10:52:29.540Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97146973acc04990","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c4c5e8052b11b3c3c875d300ea98e1c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.576Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-397f5c5fdbfa2cc82dbbdcc2: done: 0.021127 sec","job_status":"done","queue_duration_s":1.342837,"scheduling_latency_s":1.342861,"redis_calls":10,"redis_duration_s":0.001889,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021127,"completed_at":"2026-10-10T10:52:30.939Z","load_balancing_strategy":"primary","db_duration_s":0.001639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 474.288929] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"df564cb12d5ce4e53a3a2e1a","created_at":"2026-10-10T10:52:29.575Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"168969c7f36eab30e30eacf3aa1b6f21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:52:29.596Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-df564cb12d5ce4e53a3a2e1a: start","job_status":"start","queue_duration_s":1.345144,"scheduling_latency_s":1.345165}2292gitlab # [ 474.302745] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"df564cb12d5ce4e53a3a2e1a","created_at":"2026-10-10T10:52:29.575Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"168969c7f36eab30e30eacf3aa1b6f21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-10T10:52:29.596Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-df564cb12d5ce4e53a3a2e1a: done: 0.032408 sec","job_status":"done","queue_duration_s":1.345144,"scheduling_latency_s":1.345165,"redis_calls":9,"redis_duration_s":0.001653,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032408,"completed_at":"2026-10-10T10:52:30.973Z","load_balancing_strategy":"primary","db_duration_s":0.004093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 474.345930] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7034543f2137487a1d928676","created_at":"2026-10-10T10:52:29.610Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a6765a6843f3f8b286dea9d4d57088e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.623Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7034543f2137487a1d928676: start","job_status":"start","queue_duration_s":1.351358,"scheduling_latency_s":1.35138}2294gitlab # [ 474.361357] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.988Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2295gitlab # [ 474.365308] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7034543f2137487a1d928676","created_at":"2026-10-10T10:52:29.610Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a6765a6843f3f8b286dea9d4d57088e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.623Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7034543f2137487a1d928676: done: 0.021974 sec","job_status":"done","queue_duration_s":1.351358,"scheduling_latency_s":1.35138,"redis_calls":9,"redis_duration_s":0.003155,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001913,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021974,"completed_at":"2026-10-10T10:52:30.997Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 474.409561] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:30.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b314e30a459d09274159caf6","created_at":"2026-10-10T10:52:29.630Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bebb128caf5de5edf9a5df4293128392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.646Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b314e30a459d09274159caf6: start","job_status":"start","queue_duration_s":1.352141,"scheduling_latency_s":1.352163}2297gitlab # [ 474.425169] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.010Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2298gitlab # [ 474.428510] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b314e30a459d09274159caf6","created_at":"2026-10-10T10:52:29.630Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bebb128caf5de5edf9a5df4293128392","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.646Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b314e30a459d09274159caf6: done: 0.017897 sec","job_status":"done","queue_duration_s":1.352141,"scheduling_latency_s":1.352163,"redis_calls":9,"redis_duration_s":0.001636,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017897,"completed_at":"2026-10-10T10:52:31.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 474.473524] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.018Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1df59102b014cd8b10d21743","created_at":"2026-10-10T10:52:29.860Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10e095749e5ed8f1dcc063ffb27b3545","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.876Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1df59102b014cd8b10d21743: start","job_status":"start","queue_duration_s":1.141102,"scheduling_latency_s":1.141118}2300gitlab # [ 474.487467] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.036Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1df59102b014cd8b10d21743","created_at":"2026-10-10T10:52:29.860Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10e095749e5ed8f1dcc063ffb27b3545","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.876Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1df59102b014cd8b10d21743: done: 0.018271 sec","job_status":"done","queue_duration_s":1.141102,"scheduling_latency_s":1.141118,"redis_calls":11,"redis_duration_s":0.001882,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000339,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000362,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018271,"completed_at":"2026-10-10T10:52:31.036Z","load_balancing_strategy":"primary","db_duration_s":0.000398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 474.531946] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a5afd223a87b5b4139544a26","created_at":"2026-10-10T10:52:29.903Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9c6516e5f3a12ae00497d729852e3df","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.927Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a5afd223a87b5b4139544a26: start","job_status":"start","queue_duration_s":1.109999,"scheduling_latency_s":1.110014}2302gitlab # [ 474.548048] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a5afd223a87b5b4139544a26","created_at":"2026-10-10T10:52:29.903Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9c6516e5f3a12ae00497d729852e3df","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.927Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a5afd223a87b5b4139544a26: done: 0.028813 sec","job_status":"done","queue_duration_s":1.109999,"scheduling_latency_s":1.110014,"redis_calls":12,"redis_duration_s":0.00219,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00902052,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.028813,"completed_at":"2026-10-10T10:52:31.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002711,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2303gitlab # [ 474.594738] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5840418224f4b9de3628cded","created_at":"2026-10-10T10:52:29.945Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b8eff32bc5d2512c7fda2030a28e9a9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.958Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5840418224f4b9de3628cded: start","job_status":"start","queue_duration_s":1.108825,"scheduling_latency_s":1.108842}2304gitlab # [ 474.609766] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5840418224f4b9de3628cded","created_at":"2026-10-10T10:52:29.945Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b8eff32bc5d2512c7fda2030a28e9a9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.958Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5840418224f4b9de3628cded: done: 0.030117 sec","job_status":"done","queue_duration_s":1.108825,"scheduling_latency_s":1.108842,"redis_calls":9,"redis_duration_s":0.00173,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030117,"completed_at":"2026-10-10T10:52:31.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 474.653764] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a10c5d8de598a896211bb1f6","created_at":"2026-10-10T10:52:29.963Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce98c010835e280e0e8c16b874b6d093","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.985Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a10c5d8de598a896211bb1f6: start","job_status":"start","queue_duration_s":1.114331,"scheduling_latency_s":1.114347}2306gitlab # [ 474.669985] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a10c5d8de598a896211bb1f6","created_at":"2026-10-10T10:52:29.963Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce98c010835e280e0e8c16b874b6d093","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:29.985Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a10c5d8de598a896211bb1f6: done: 0.027858 sec","job_status":"done","queue_duration_s":1.114331,"scheduling_latency_s":1.114347,"redis_calls":9,"redis_duration_s":0.001637,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027858,"completed_at":"2026-10-10T10:52:31.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 474.717255] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d0af530d0a794461ba19f441","created_at":"2026-10-10T10:52:30.006Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ea12144fb6a2b37a8f04bf0c20c86c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:52:30.024Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d0af530d0a794461ba19f441: start","job_status":"start","queue_duration_s":1.104181,"scheduling_latency_s":1.104197}2308gitlab # [ 474.731536] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.139Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2309gitlab # [ 474.735252] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.145Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d0af530d0a794461ba19f441","created_at":"2026-10-10T10:52:30.006Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ea12144fb6a2b37a8f04bf0c20c86c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-10T10:52:30.024Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d0af530d0a794461ba19f441: done: 0.017139 sec","job_status":"done","queue_duration_s":1.104181,"scheduling_latency_s":1.104197,"redis_calls":9,"redis_duration_s":0.001535,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00034,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017139,"completed_at":"2026-10-10T10:52:31.145Z","load_balancing_strategy":"primary","db_duration_s":0.000471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 474.779551] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cb1350e7da3b85917e71e479","created_at":"2026-10-10T10:52:30.047Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d289c85bb90f3056b499ae7e4d15ba86","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.077Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cb1350e7da3b85917e71e479: start","job_status":"start","queue_duration_s":1.070081,"scheduling_latency_s":1.070098}2311gitlab # [ 474.794680] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cb1350e7da3b85917e71e479","created_at":"2026-10-10T10:52:30.047Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d289c85bb90f3056b499ae7e4d15ba86","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.077Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cb1350e7da3b85917e71e479: done: 0.032395 sec","job_status":"done","queue_duration_s":1.070081,"scheduling_latency_s":1.070098,"redis_calls":9,"redis_duration_s":0.001693,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.032395,"completed_at":"2026-10-10T10:52:31.179Z","load_balancing_strategy":"primary","db_duration_s":0.010882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 474.840407] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bfa173d18a65345048b962a5","created_at":"2026-10-10T10:52:30.106Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca0d8d9dbb6c5aa8778d68ec1877c9c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.122Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bfa173d18a65345048b962a5: start","job_status":"start","queue_duration_s":1.058781,"scheduling_latency_s":1.058796}2313gitlab # [ 474.854873] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bfa173d18a65345048b962a5","created_at":"2026-10-10T10:52:30.106Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca0d8d9dbb6c5aa8778d68ec1877c9c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.122Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bfa173d18a65345048b962a5: done: 0.025661 sec","job_status":"done","queue_duration_s":1.058781,"scheduling_latency_s":1.058796,"redis_calls":11,"redis_duration_s":0.00231,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050886,"exclusive_lock_hold_duration_s":0.00670722,"duration_s":0.025661,"completed_at":"2026-10-10T10:52:31.206Z","load_balancing_strategy":"primary","db_duration_s":0.003212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2314gitlab # [ 474.901135] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"10740001491aef803932f628","created_at":"2026-10-10T10:52:30.147Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"194af0f10010f63a6ddc06c62c527249","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.167Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-10740001491aef803932f628: start","job_status":"start","queue_duration_s":1.040257,"scheduling_latency_s":1.040273}2315gitlab # [ 474.917418] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"10740001491aef803932f628","created_at":"2026-10-10T10:52:30.147Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"194af0f10010f63a6ddc06c62c527249","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.167Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-10740001491aef803932f628: done: 0.042053 sec","job_status":"done","queue_duration_s":1.040257,"scheduling_latency_s":1.040273,"redis_calls":11,"redis_duration_s":0.002355,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065154,"exclusive_lock_hold_duration_s":0.01565412,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.042053,"completed_at":"2026-10-10T10:52:31.249Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2316gitlab # [ 474.965573] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0456079e1fe4dd7d71b3aa4d","created_at":"2026-10-10T10:52:30.179Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ee4a0959ff7bf597b90e639566ff38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.196Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0456079e1fe4dd7d71b3aa4d: start","job_status":"start","queue_duration_s":1.054438,"scheduling_latency_s":1.054455}2317gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2318gitlab # [ 474.980609] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0456079e1fe4dd7d71b3aa4d","created_at":"2026-10-10T10:52:30.179Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-97d0e983b775400d","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ee4a0959ff7bf597b90e639566ff38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.196Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0456079e1fe4dd7d71b3aa4d: done: 0.230816 sec","job_status":"done","queue_duration_s":1.054438,"scheduling_latency_s":1.054455,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000707,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046784,"exclusive_lock_hold_duration_s":0.20541036,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.230816,"completed_at":"2026-10-10T10:52:31.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 475.026540] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06e5823aa12c2d84fc7172d3","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06e5823aa12c2d84fc7172d3: start","job_status":"start","queue_duration_s":1.211862,"scheduling_latency_s":1.211884}2320gitlab # [ 475.039969] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06e5823aa12c2d84fc7172d3","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06e5823aa12c2d84fc7172d3: done: 0.027027 sec","job_status":"done","queue_duration_s":1.211862,"scheduling_latency_s":1.211884,"redis_calls":15,"redis_duration_s":0.002993,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001832,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027027,"completed_at":"2026-10-10T10:52:31.510Z","load_balancing_strategy":"primary","db_duration_s":0.000417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 475.083845] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ede525e6d0c093eaf22ce39f","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ede525e6d0c093eaf22ce39f: start","job_status":"start","queue_duration_s":1.240756,"scheduling_latency_s":1.240775}2322gitlab # [ 475.098165] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ede525e6d0c093eaf22ce39f","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ede525e6d0c093eaf22ce39f: done: 0.016468 sec","job_status":"done","queue_duration_s":1.240756,"scheduling_latency_s":1.240775,"redis_calls":13,"redis_duration_s":0.002024,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016468,"completed_at":"2026-10-10T10:52:31.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.17 seconds)2324gitlab # [ 475.151546] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5d396e363ed437883b7fe8e","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5d396e363ed437883b7fe8e: start","job_status":"start","queue_duration_s":1.258738,"scheduling_latency_s":1.258756}2325gitlab # [ 475.172903] gitaly[903]: time="2026-10-10T10:52:31.982Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2T9E5M1F12E037K4ZPKF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:01.780" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:31.981" grpc.time_ms=0.96 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 475.192100] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 982327gitlab # [ 475.195607] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5d396e363ed437883b7fe8e","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5d396e363ed437883b7fe8e: done: 0.015809 sec","job_status":"done","queue_duration_s":1.258738,"scheduling_latency_s":1.258756,"redis_calls":13,"redis_duration_s":0.001899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015809,"completed_at":"2026-10-10T10:52:31.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 475.241290] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e09eac52ad04e59db1b2354","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e09eac52ad04e59db1b2354: start","job_status":"start","queue_duration_s":1.275923,"scheduling_latency_s":1.275939}2329gitlab # [ 475.255074] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e09eac52ad04e59db1b2354","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e09eac52ad04e59db1b2354: done: 0.016764 sec","job_status":"done","queue_duration_s":1.275923,"scheduling_latency_s":1.275939,"redis_calls":13,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016764,"completed_at":"2026-10-10T10:52:31.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 475.296958] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d05143cfff787a0a6d77ef7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d05143cfff787a0a6d77ef7: start","job_status":"start","queue_duration_s":1.293986,"scheduling_latency_s":1.294005}2331gitlab # [ 475.311314] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d05143cfff787a0a6d77ef7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d05143cfff787a0a6d77ef7: done: 0.016614 sec","job_status":"done","queue_duration_s":1.293986,"scheduling_latency_s":1.294005,"redis_calls":13,"redis_duration_s":0.002158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016614,"completed_at":"2026-10-10T10:52:31.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 475.353159] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0997dc6e7cb9f0e2a56144a1","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0997dc6e7cb9f0e2a56144a1: start","job_status":"start","queue_duration_s":1.311943,"scheduling_latency_s":1.311961}2333gitlab # [ 475.366361] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0997dc6e7cb9f0e2a56144a1","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0997dc6e7cb9f0e2a56144a1: done: 0.016545 sec","job_status":"done","queue_duration_s":1.311943,"scheduling_latency_s":1.311961,"redis_calls":13,"redis_duration_s":0.002173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016545,"completed_at":"2026-10-10T10:52:31.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 475.408070] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc715af3b55aa71e3b6450b4","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc715af3b55aa71e3b6450b4: start","job_status":"start","queue_duration_s":1.329999,"scheduling_latency_s":1.330013}2335gitlab # [ 475.421128] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc715af3b55aa71e3b6450b4","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc715af3b55aa71e3b6450b4: done: 0.015315 sec","job_status":"done","queue_duration_s":1.329999,"scheduling_latency_s":1.330013,"redis_calls":13,"redis_duration_s":0.002137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015315,"completed_at":"2026-10-10T10:52:31.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 475.463414] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b28b0d8f2727cf980940d903","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b28b0d8f2727cf980940d903: start","job_status":"start","queue_duration_s":1.34654,"scheduling_latency_s":1.346555}2337gitlab # [ 475.477068] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b28b0d8f2727cf980940d903","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b28b0d8f2727cf980940d903: done: 0.015497 sec","job_status":"done","queue_duration_s":1.34654,"scheduling_latency_s":1.346555,"redis_calls":13,"redis_duration_s":0.002201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015497,"completed_at":"2026-10-10T10:52:31.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab # [ 475.519318] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f5c74538dfe97f3ae873257","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f5c74538dfe97f3ae873257: start","job_status":"start","queue_duration_s":1.363606,"scheduling_latency_s":1.363621}2339gitlab # [ 475.532543] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f5c74538dfe97f3ae873257","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f5c74538dfe97f3ae873257: done: 0.015678 sec","job_status":"done","queue_duration_s":1.363606,"scheduling_latency_s":1.363621,"redis_calls":13,"redis_duration_s":0.002014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015678,"completed_at":"2026-10-10T10:52:31.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2340gitlab # [ 475.573466] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db06a24e41dab25b64cff7c7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db06a24e41dab25b64cff7c7: start","job_status":"start","queue_duration_s":1.381009,"scheduling_latency_s":1.381025}2341gitlab # [ 475.586485] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db06a24e41dab25b64cff7c7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db06a24e41dab25b64cff7c7: done: 0.016232 sec","job_status":"done","queue_duration_s":1.381009,"scheduling_latency_s":1.381025,"redis_calls":13,"redis_duration_s":0.0020599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016232,"completed_at":"2026-10-10T10:52:31.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 475.627940] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767e2e8dc437a5190340a7cf","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767e2e8dc437a5190340a7cf: start","job_status":"start","queue_duration_s":1.399216,"scheduling_latency_s":1.399233}2343gitlab # [ 475.641142] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767e2e8dc437a5190340a7cf","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767e2e8dc437a5190340a7cf: done: 0.016634 sec","job_status":"done","queue_duration_s":1.399216,"scheduling_latency_s":1.399233,"redis_calls":13,"redis_duration_s":0.002138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016634,"completed_at":"2026-10-10T10:52:31.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 475.682168] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c049e88f4969cb8bdf577f6","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c049e88f4969cb8bdf577f6: start","job_status":"start","queue_duration_s":1.417654,"scheduling_latency_s":1.41767}2345gitlab # [ 475.695270] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c049e88f4969cb8bdf577f6","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c049e88f4969cb8bdf577f6: done: 0.016621 sec","job_status":"done","queue_duration_s":1.417654,"scheduling_latency_s":1.41767,"redis_calls":13,"redis_duration_s":0.00263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016621,"completed_at":"2026-10-10T10:52:31.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2346gitlab # [ 475.737837] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02cd3f0e961d948f98c7fa95","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02cd3f0e961d948f98c7fa95: start","job_status":"start","queue_duration_s":1.436126,"scheduling_latency_s":1.436143}2347gitlab # [ 475.750994] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02cd3f0e961d948f98c7fa95","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02cd3f0e961d948f98c7fa95: done: 0.015264 sec","job_status":"done","queue_duration_s":1.436126,"scheduling_latency_s":1.436143,"redis_calls":13,"redis_duration_s":0.002072,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015264,"completed_at":"2026-10-10T10:52:31.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 475.792257] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e954521bd9765007fcf62d5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e954521bd9765007fcf62d5: start","job_status":"start","queue_duration_s":1.452549,"scheduling_latency_s":1.452564}2349gitlab # [ 475.805416] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e954521bd9765007fcf62d5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e954521bd9765007fcf62d5: done: 0.013811 sec","job_status":"done","queue_duration_s":1.452549,"scheduling_latency_s":1.452564,"redis_calls":13,"redis_duration_s":0.001955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013811,"completed_at":"2026-10-10T10:52:31.738Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 475.846664] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54e542b5f812c52390681607","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54e542b5f812c52390681607: start","job_status":"start","queue_duration_s":1.467573,"scheduling_latency_s":1.46759}2351gitlab # [ 475.859884] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54e542b5f812c52390681607","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54e542b5f812c52390681607: done: 0.01412 sec","job_status":"done","queue_duration_s":1.467573,"scheduling_latency_s":1.46759,"redis_calls":13,"redis_duration_s":0.002169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001464,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01412,"completed_at":"2026-10-10T10:52:31.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 475.901720] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b9ab41d25df36057a62aa98","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b9ab41d25df36057a62aa98: start","job_status":"start","queue_duration_s":1.483055,"scheduling_latency_s":1.483073}2353gitlab # [ 475.914764] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b9ab41d25df36057a62aa98","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b9ab41d25df36057a62aa98: done: 0.014327 sec","job_status":"done","queue_duration_s":1.483055,"scheduling_latency_s":1.483073,"redis_calls":13,"redis_duration_s":0.002148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014327,"completed_at":"2026-10-10T10:52:31.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 475.957742] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae04484863a6eed5c87626ad","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae04484863a6eed5c87626ad: start","job_status":"start","queue_duration_s":1.498652,"scheduling_latency_s":1.498739}2355gitlab # [ 475.970931] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae04484863a6eed5c87626ad","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae04484863a6eed5c87626ad: done: 0.014653 sec","job_status":"done","queue_duration_s":1.498652,"scheduling_latency_s":1.498739,"redis_calls":13,"redis_duration_s":0.002199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014653,"completed_at":"2026-10-10T10:52:31.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 476.012402] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4437aa7085986f17cba6030","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4437aa7085986f17cba6030: start","job_status":"start","queue_duration_s":1.514567,"scheduling_latency_s":1.514584}2357gitlab # [ 476.025452] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4437aa7085986f17cba6030","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4437aa7085986f17cba6030: done: 0.014517 sec","job_status":"done","queue_duration_s":1.514567,"scheduling_latency_s":1.514584,"redis_calls":13,"redis_duration_s":0.002255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014517,"completed_at":"2026-10-10T10:52:31.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 476.066571] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e716c10ca0b4464b2af425","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e716c10ca0b4464b2af425: start","job_status":"start","queue_duration_s":1.530571,"scheduling_latency_s":1.530586}2359gitlab # [ 476.079660] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e716c10ca0b4464b2af425","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e716c10ca0b4464b2af425: done: 0.013913 sec","job_status":"done","queue_duration_s":1.530571,"scheduling_latency_s":1.530586,"redis_calls":13,"redis_duration_s":0.0020480000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013913,"completed_at":"2026-10-10T10:52:31.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 476.121285] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c08fbca8ddb8889c10a2a10","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c08fbca8ddb8889c10a2a10: start","job_status":"start","queue_duration_s":1.545671,"scheduling_latency_s":1.545686}2361gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2362gitlab # [ 476.135711] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c08fbca8ddb8889c10a2a10","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c08fbca8ddb8889c10a2a10: done: 0.013639 sec","job_status":"done","queue_duration_s":1.545671,"scheduling_latency_s":1.545686,"redis_calls":13,"redis_duration_s":0.001806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013639,"completed_at":"2026-10-10T10:52:31.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 476.176140] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0defb39c02293490570aeae6","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0defb39c02293490570aeae6: start","job_status":"start","queue_duration_s":1.560461,"scheduling_latency_s":1.560475}2364gitlab # [ 476.189008] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0defb39c02293490570aeae6","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0defb39c02293490570aeae6: done: 0.014376 sec","job_status":"done","queue_duration_s":1.560461,"scheduling_latency_s":1.560475,"redis_calls":13,"redis_duration_s":0.0019560000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014376,"completed_at":"2026-10-10T10:52:31.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 476.230207] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9ed40629056966360f11647","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9ed40629056966360f11647: start","job_status":"start","queue_duration_s":1.575947,"scheduling_latency_s":1.575961}2366gitlab # [ 476.243389] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9ed40629056966360f11647","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9ed40629056966360f11647: done: 0.013791 sec","job_status":"done","queue_duration_s":1.575947,"scheduling_latency_s":1.575961,"redis_calls":13,"redis_duration_s":0.001846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013791,"completed_at":"2026-10-10T10:52:31.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 476.284876] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae091fa08f523ef06a6f024","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae091fa08f523ef06a6f024: start","job_status":"start","queue_duration_s":1.590908,"scheduling_latency_s":1.590923}2368gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.15 seconds)2369gitlab # [ 476.297890] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae091fa08f523ef06a6f024","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae091fa08f523ef06a6f024: done: 0.013881 sec","job_status":"done","queue_duration_s":1.590908,"scheduling_latency_s":1.590923,"redis_calls":13,"redis_duration_s":0.001921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013881,"completed_at":"2026-10-10T10:52:31.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 476.338091] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db98219e25cb9a1b4ef2933","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db98219e25cb9a1b4ef2933: start","job_status":"start","queue_duration_s":1.60597,"scheduling_latency_s":1.605986}2371gitlab # [ 476.352708] gitaly[903]: time="2026-10-10T10:52:33.140Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2VDK49SETS5RB8G4G64Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:03.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:33.139" grpc.time_ms=0.895 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 476.366270] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 972373gitlab # [ 476.369016] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db98219e25cb9a1b4ef2933","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db98219e25cb9a1b4ef2933: done: 0.014089 sec","job_status":"done","queue_duration_s":1.60597,"scheduling_latency_s":1.605986,"redis_calls":13,"redis_duration_s":0.0019190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014089,"completed_at":"2026-10-10T10:52:31.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 476.409194] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c397b14f34ef52e68a24add9","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c397b14f34ef52e68a24add9: start","job_status":"start","queue_duration_s":1.621277,"scheduling_latency_s":1.621292}2375gitlab # [ 476.421957] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c397b14f34ef52e68a24add9","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c397b14f34ef52e68a24add9: done: 0.022557 sec","job_status":"done","queue_duration_s":1.621277,"scheduling_latency_s":1.621292,"redis_calls":13,"redis_duration_s":0.003146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022557,"completed_at":"2026-10-10T10:52:31.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 476.462289] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"934d4d7c134cb6af62122b4c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-934d4d7c134cb6af62122b4c: start","job_status":"start","queue_duration_s":1.646285,"scheduling_latency_s":1.646309}2377gitlab # [ 476.475309] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"934d4d7c134cb6af62122b4c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-934d4d7c134cb6af62122b4c: done: 0.015189 sec","job_status":"done","queue_duration_s":1.646285,"scheduling_latency_s":1.646309,"redis_calls":13,"redis_duration_s":0.001962,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015189,"completed_at":"2026-10-10T10:52:31.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 476.518967] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3650fb04d7a6ac4c2cbe1009","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3650fb04d7a6ac4c2cbe1009: start","job_status":"start","queue_duration_s":1.662558,"scheduling_latency_s":1.662573}2379gitlab # [ 476.532901] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3650fb04d7a6ac4c2cbe1009","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3650fb04d7a6ac4c2cbe1009: done: 0.01385 sec","job_status":"done","queue_duration_s":1.662558,"scheduling_latency_s":1.662573,"redis_calls":13,"redis_duration_s":0.0018609999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01385,"completed_at":"2026-10-10T10:52:31.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 476.575972] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1094b341eb3029edbe32122a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1094b341eb3029edbe32122a: start","job_status":"start","queue_duration_s":1.677564,"scheduling_latency_s":1.67758}2381gitlab # [ 476.589160] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1094b341eb3029edbe32122a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1094b341eb3029edbe32122a: done: 0.014503 sec","job_status":"done","queue_duration_s":1.677564,"scheduling_latency_s":1.67758,"redis_calls":13,"redis_duration_s":0.001962,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001284,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014503,"completed_at":"2026-10-10T10:52:31.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 476.629978] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef27024c34f0ceb7e50fd99","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef27024c34f0ceb7e50fd99: start","job_status":"start","queue_duration_s":1.693295,"scheduling_latency_s":1.693311}2383gitlab # [ 476.642973] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef27024c34f0ceb7e50fd99","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef27024c34f0ceb7e50fd99: done: 0.018429 sec","job_status":"done","queue_duration_s":1.693295,"scheduling_latency_s":1.693311,"redis_calls":13,"redis_duration_s":0.004698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018429,"completed_at":"2026-10-10T10:52:31.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 476.683992] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:31.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2875b2b369f6aacbb760218a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2875b2b369f6aacbb760218a: start","job_status":"start","queue_duration_s":1.713196,"scheduling_latency_s":1.713213}2385gitlab # [ 476.696665] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2875b2b369f6aacbb760218a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2875b2b369f6aacbb760218a: done: 0.0164 sec","job_status":"done","queue_duration_s":1.713196,"scheduling_latency_s":1.713213,"redis_calls":13,"redis_duration_s":0.002575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001566,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0164,"completed_at":"2026-10-10T10:52:32.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 476.736793] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b23c78d94a1c18779ba42164","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b23c78d94a1c18779ba42164: start","job_status":"start","queue_duration_s":1.731331,"scheduling_latency_s":1.731349}2387gitlab # [ 476.749533] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b23c78d94a1c18779ba42164","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b23c78d94a1c18779ba42164: done: 0.016479 sec","job_status":"done","queue_duration_s":1.731331,"scheduling_latency_s":1.731349,"redis_calls":13,"redis_duration_s":0.002274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016479,"completed_at":"2026-10-10T10:52:32.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 476.790674] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a751880be1587d8fd238bd0e","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a751880be1587d8fd238bd0e: start","job_status":"start","queue_duration_s":1.749532,"scheduling_latency_s":1.749565}2389gitlab # [ 476.803743] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a751880be1587d8fd238bd0e","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a751880be1587d8fd238bd0e: done: 0.015831 sec","job_status":"done","queue_duration_s":1.749532,"scheduling_latency_s":1.749565,"redis_calls":13,"redis_duration_s":0.002338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015831,"completed_at":"2026-10-10T10:52:32.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 476.844119] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1737217544a43bd0719c14d","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1737217544a43bd0719c14d: start","job_status":"start","queue_duration_s":1.766632,"scheduling_latency_s":1.766648}2391gitlab # [ 476.856813] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1737217544a43bd0719c14d","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1737217544a43bd0719c14d: done: 0.013982 sec","job_status":"done","queue_duration_s":1.766632,"scheduling_latency_s":1.766648,"redis_calls":13,"redis_duration_s":0.001841,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013982,"completed_at":"2026-10-10T10:52:32.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 476.897074] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"529ca531b384e88faef36fb5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-529ca531b384e88faef36fb5: start","job_status":"start","queue_duration_s":1.781867,"scheduling_latency_s":1.781885}2393gitlab # [ 476.909818] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"529ca531b384e88faef36fb5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-529ca531b384e88faef36fb5: done: 0.014511 sec","job_status":"done","queue_duration_s":1.781867,"scheduling_latency_s":1.781885,"redis_calls":13,"redis_duration_s":0.002201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014511,"completed_at":"2026-10-10T10:52:32.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 476.949897] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb8221c7ffbf452c9a7599a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb8221c7ffbf452c9a7599a: start","job_status":"start","queue_duration_s":1.797733,"scheduling_latency_s":1.797753}2395gitlab # [ 476.962681] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb8221c7ffbf452c9a7599a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb8221c7ffbf452c9a7599a: done: 0.014948 sec","job_status":"done","queue_duration_s":1.797733,"scheduling_latency_s":1.797753,"redis_calls":13,"redis_duration_s":0.00215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014948,"completed_at":"2026-10-10T10:52:32.084Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab # [ 477.004034] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6367e4255b298a08a93af8a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6367e4255b298a08a93af8a: start","job_status":"start","queue_duration_s":1.814109,"scheduling_latency_s":1.814133}2397gitlab # [ 477.016615] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6367e4255b298a08a93af8a","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6367e4255b298a08a93af8a: done: 0.015627 sec","job_status":"done","queue_duration_s":1.814109,"scheduling_latency_s":1.814133,"redis_calls":13,"redis_duration_s":0.00245,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001624,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015627,"completed_at":"2026-10-10T10:52:32.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 477.057116] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f1bfe135f5c146d7fd54654","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f1bfe135f5c146d7fd54654: start","job_status":"start","queue_duration_s":1.831282,"scheduling_latency_s":1.831308}2399gitlab # [ 477.070049] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f1bfe135f5c146d7fd54654","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f1bfe135f5c146d7fd54654: done: 0.016016 sec","job_status":"done","queue_duration_s":1.831282,"scheduling_latency_s":1.831308,"redis_calls":13,"redis_duration_s":0.002412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001619,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016016,"completed_at":"2026-10-10T10:52:32.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 477.110103] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86f27e0ee1419d17a71fe2c1","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86f27e0ee1419d17a71fe2c1: start","job_status":"start","queue_duration_s":1.848755,"scheduling_latency_s":1.84878}2401gitlab # [ 477.123250] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86f27e0ee1419d17a71fe2c1","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86f27e0ee1419d17a71fe2c1: done: 0.015602 sec","job_status":"done","queue_duration_s":1.848755,"scheduling_latency_s":1.84878,"redis_calls":13,"redis_duration_s":0.0021520000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015602,"completed_at":"2026-10-10T10:52:32.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 477.164143] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a7db3cbcec5332745092425","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a7db3cbcec5332745092425: start","job_status":"start","queue_duration_s":1.865795,"scheduling_latency_s":1.865821}2403gitlab # [ 477.176986] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a7db3cbcec5332745092425","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a7db3cbcec5332745092425: done: 0.01567 sec","job_status":"done","queue_duration_s":1.865795,"scheduling_latency_s":1.865821,"redis_calls":13,"redis_duration_s":0.002155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01567,"completed_at":"2026-10-10T10:52:32.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 477.218692] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a53fe01d8ecfb06b4aa5cbe2","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a53fe01d8ecfb06b4aa5cbe2: start","job_status":"start","queue_duration_s":1.882976,"scheduling_latency_s":1.883002}2405gitlab # [ 477.231487] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a53fe01d8ecfb06b4aa5cbe2","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a53fe01d8ecfb06b4aa5cbe2: done: 0.015026 sec","job_status":"done","queue_duration_s":1.882976,"scheduling_latency_s":1.883002,"redis_calls":13,"redis_duration_s":0.001956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015026,"completed_at":"2026-10-10T10:52:32.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 477.272074] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e90f9a3509ffd72b993f6ea","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e90f9a3509ffd72b993f6ea: start","job_status":"start","queue_duration_s":1.899334,"scheduling_latency_s":1.899357}2407gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2408gitlab # [ 477.284905] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e90f9a3509ffd72b993f6ea","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e90f9a3509ffd72b993f6ea: done: 0.014218 sec","job_status":"done","queue_duration_s":1.899334,"scheduling_latency_s":1.899357,"redis_calls":13,"redis_duration_s":0.001823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014218,"completed_at":"2026-10-10T10:52:32.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 477.324221] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9206e866c7703c41303bf21c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9206e866c7703c41303bf21c: start","job_status":"start","queue_duration_s":1.914977,"scheduling_latency_s":1.915001}2410gitlab # [ 477.336317] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9206e866c7703c41303bf21c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9206e866c7703c41303bf21c: done: 0.014308 sec","job_status":"done","queue_duration_s":1.914977,"scheduling_latency_s":1.915001,"redis_calls":13,"redis_duration_s":0.001839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014308,"completed_at":"2026-10-10T10:52:32.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 477.376931] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c8a3d5ee025d24e21dd65c9","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c8a3d5ee025d24e21dd65c9: start","job_status":"start","queue_duration_s":1.930618,"scheduling_latency_s":1.930641}2412gitlab # [ 477.389754] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c8a3d5ee025d24e21dd65c9","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c8a3d5ee025d24e21dd65c9: done: 0.014869 sec","job_status":"done","queue_duration_s":1.930618,"scheduling_latency_s":1.930641,"redis_calls":13,"redis_duration_s":0.002002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014869,"completed_at":"2026-10-10T10:52:32.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 477.431325] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b415c83078e1f4a2fbfa9223","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b415c83078e1f4a2fbfa9223: start","job_status":"start","queue_duration_s":1.946982,"scheduling_latency_s":1.947007}2414gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.14 seconds)2415gitlab # [ 477.444327] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b415c83078e1f4a2fbfa9223","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b415c83078e1f4a2fbfa9223: done: 0.014562 sec","job_status":"done","queue_duration_s":1.946982,"scheduling_latency_s":1.947007,"redis_calls":13,"redis_duration_s":0.001874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014562,"completed_at":"2026-10-10T10:52:32.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 477.485446] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a0250d9079cca87a75634f5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a0250d9079cca87a75634f5: start","job_status":"start","queue_duration_s":1.963037,"scheduling_latency_s":1.96306}2417gitlab # [ 477.498786] gitaly[903]: time="2026-10-10T10:52:34.292Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2WHNVKKAFDDZ5FSRWXYZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:04.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:34.291" grpc.time_ms=0.611 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2418gitlab # [ 477.512655] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 882419gitlab # [ 477.515331] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a0250d9079cca87a75634f5","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a0250d9079cca87a75634f5: done: 0.014545 sec","job_status":"done","queue_duration_s":1.963037,"scheduling_latency_s":1.96306,"redis_calls":13,"redis_duration_s":0.001964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014545,"completed_at":"2026-10-10T10:52:32.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 477.557869] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af529d351a62c705ed88a3e3","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af529d351a62c705ed88a3e3: start","job_status":"start","queue_duration_s":1.979146,"scheduling_latency_s":1.97917}2421gitlab # [ 477.571435] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af529d351a62c705ed88a3e3","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af529d351a62c705ed88a3e3: done: 0.014843 sec","job_status":"done","queue_duration_s":1.979146,"scheduling_latency_s":1.97917,"redis_calls":13,"redis_duration_s":0.0019909999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014843,"completed_at":"2026-10-10T10:52:32.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 477.613124] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f63fa18bfa767f32eb1ae1c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f63fa18bfa767f32eb1ae1c: start","job_status":"start","queue_duration_s":1.995411,"scheduling_latency_s":1.995436}2423gitlab # [ 477.626142] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f63fa18bfa767f32eb1ae1c","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f63fa18bfa767f32eb1ae1c: done: 0.014862 sec","job_status":"done","queue_duration_s":1.995411,"scheduling_latency_s":1.995436,"redis_calls":13,"redis_duration_s":0.002064,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014862,"completed_at":"2026-10-10T10:52:32.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 477.669347] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20fd438cbe0fa246667f18e7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20fd438cbe0fa246667f18e7: start","job_status":"start","queue_duration_s":2.011802,"scheduling_latency_s":2.011827}2425gitlab # [ 477.682392] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20fd438cbe0fa246667f18e7","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20fd438cbe0fa246667f18e7: done: 0.01544 sec","job_status":"done","queue_duration_s":2.011802,"scheduling_latency_s":2.011827,"redis_calls":13,"redis_duration_s":0.0020350000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01544,"completed_at":"2026-10-10T10:52:32.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 477.722693] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9c4d6bb1b22f82db6c32dc4","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9c4d6bb1b22f82db6c32dc4: start","job_status":"start","queue_duration_s":2.028711,"scheduling_latency_s":2.028733}2427gitlab # [ 477.735787] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9c4d6bb1b22f82db6c32dc4","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9c4d6bb1b22f82db6c32dc4: done: 0.015096 sec","job_status":"done","queue_duration_s":2.028711,"scheduling_latency_s":2.028733,"redis_calls":13,"redis_duration_s":0.002304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015096,"completed_at":"2026-10-10T10:52:32.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2428gitlab # [ 477.778495] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a621c0b9c423f9dfc57a4ff","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a621c0b9c423f9dfc57a4ff: start","job_status":"start","queue_duration_s":2.045154,"scheduling_latency_s":2.04517}2429gitlab # [ 477.793088] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:32.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a621c0b9c423f9dfc57a4ff","created_at":"2026-10-10T10:52:30.036Z","trace_propagation_headers":{"sentry-trace":"4372cb7a831743f3bfadbba492c1d08e-3e727913a5694ad2","baggage":"sentry-trace_id=4372cb7a831743f3bfadbba492c1d08e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"50f779e25fab9eff12b9ad5875c5bea5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-10T10:52:30.271Z","job_size_bytes":2,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a621c0b9c423f9dfc57a4ff: done: 0.019598 sec","job_status":"done","queue_duration_s":2.045154,"scheduling_latency_s":2.04517,"redis_calls":13,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019598,"completed_at":"2026-10-10T10:52:32.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2430gitlab # [ 477.840120] nix-daemon[4054]: accepted connection from pid 5150, user nixbot2431gitlab # [ 477.904597] gitaly[903]: time="2026-10-10T10:52:34.771Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2WZXXDKRP1D7QCHB02CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:04.469" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:34.770" grpc.time_ms=0.984 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2432gitlab # [ 477.977211] gitaly[903]: time="2026-10-10T10:52:34.843Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2WZXXDKRP1D7QCHB02CQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:44.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:34.832" grpc.time_ms=10.771 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 478.048286] sidekiq-cluster[3767]: {"severity":"INFO","time":"2026-10-10T10:52:34.914Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"517fc1496419db7fd377a236","created_at":"2026-10-10T10:52:34.902Z","trace_propagation_headers":{"sentry-trace":"b3858dfab6d4411593db1075d0e6404c-79fa5408b885468e","baggage":"sentry-trace_id=b3858dfab6d4411593db1075d0e6404c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4JQ2WZXXDKRP1D7QCHB02CQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-10T10:52:34.910Z","job_size_bytes":3,"pid":3767,"sidekiq_tid":"m8y3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-517fc1496419db7fd377a236: start","job_status":"start","queue_duration_s":0.003848,"scheduling_latency_s":0.003895}2434gitlab # [ 478.076635] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2572435gitlab # [ 478.171235] gitaly[903]: time="2026-10-10T10:52:35.038Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2X89B862H9A3M70C8PCE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:05.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:35.036" grpc.time_ms=0.867 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2436gitlab # [ 478.255522] gitaly[903]: time="2026-10-10T10:52:35.122Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2X89B862H9A3M70C8PCE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:45.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:35.111" grpc.time_ms=11.031 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2437gitlab # [ 478.327851] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2412438gitlab # [ 478.417255] gitaly[903]: time="2026-10-10T10:52:35.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2XGCC6P6ZS3G1QP50W67 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:05.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:35.282" grpc.time_ms=0.902 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2439gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses2440gitlab # [ 478.494555] gitaly[903]: time="2026-10-10T10:52:35.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4JQ2XGCC6P6ZS3G1QP50W67 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-10T10:52:45.119" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-10T10:52:35.349" grpc.time_ms=11.284 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2441gitlab # [ 478.563776] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/37d46a43d8f3655e89a5fd47e7094252142c2170 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2172442gitlab # [ 478.569178] gitaly[903]: time="2026-10-10T10:52:35.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4JQ2XNAA8NZ7W6XWSYTY4YR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-10T10:53:05.231" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-10T10:52:35.432" grpc.time_ms=0.938 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2443gitlab # [ 478.599893] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/10/10:10:52:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 952444gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/37d46a43d8f3655e89a5fd47e7094252142c2170/statuses, in 0.15 seconds)2445(finished: subtest: eval and build post commit statuses, in 10.78 seconds)2446(finished: run the VM test script, in 554.97 seconds)2447test script finished in 555.00s2448cleanup2449kill QemuMachine (pid 46)2450gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2451(finished: cleanup, in 1.85 seconds)2452additionally exposed symbols:2453 gitlab,2454 vlan1,2455 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2456[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-10T10:50:49.716Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-10T10:52:24.545533Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2466[]2467[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2468[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2469[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2470[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2471[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2472[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2473[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2474[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2475[{'id': 5, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-10-10T10:52:24.956Z', 'started_at': None, 'finished_at': '2026-10-10T10:52:34.885Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '37d46a43d8f3655e89a5fd47e7094252142c2170', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-10-10T10:52:35.159Z', 'started_at': None, 'finished_at': '2026-10-10T10:52:35.397Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]