vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #342
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.PDMyrII9T6', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: a96f3112-a1a9-4e60-b80f-ee39ac7a1bd116gitlab # Superblock backups stored on blocks:17(finished: start all VMs, in 72.81 seconds)18gitlab # 32768, 98304, 163840, 22937619gitlab: waiting for unit setup-gitlab.service20gitlab # 21gitlab: waiting for the VM to finish booting22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dgpn0rpcwcbbr2h92sc4rpkal6frzbvr-nixos-system-gitlab-test/init regInfo=/nix/store/mk8hds55ssi7shnnpa11rdc7m4hp6da1-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mk8hds55ssi7shnnpa11rdc7m4hp6da1-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000027] arm-pv: using stolen time PV108gitlab # [ 0.000377] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000548] Console: colour dummy device 80x25110gitlab # [ 0.000555] printk: legacy console [tty0] enabled111gitlab # [ 0.000731] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000737] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000838] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000977] landlock: Up and running.115gitlab # [ 0.000980] Yama: becoming mindful.116gitlab # [ 0.001407] LSM support for eBPF active117gitlab # [ 0.001578] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001688] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002797] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003447] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003451] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003601] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004606] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004695] EFI services will not be available.125gitlab # [ 0.004890] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005509] Detected PIPT I-cache on CPU1127gitlab # [ 0.005607] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005738] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005864] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006955] Detected PIPT I-cache on CPU2131gitlab # [ 0.007063] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007195] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007327] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008448] Detected PIPT I-cache on CPU3135gitlab # [ 0.008569] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008701] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008831] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009336] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009364] SMP: Total of 4 processors activated.140gitlab # [ 0.009366] CPU: All CPU(s) started at EL1141gitlab # [ 0.009375] CPU features: detected: Branch Target Identification142gitlab # [ 0.009378] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009381] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009384] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009388] CPU features: detected: Common not Private translations146gitlab # [ 0.009391] CPU features: detected: CRC32 instructions147gitlab # [ 0.009393] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009397] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009399] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009402] CPU features: detected: E0PD151gitlab # [ 0.009404] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009407] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009409] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009412] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009414] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009418] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009421] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009423] CPU features: detected: Privileged Access Never159gitlab # [ 0.009426] CPU features: detected: PMUv3160gitlab # [ 0.009428] CPU features: detected: RAS Extension Support161gitlab # [ 0.009430] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009432] CPU features: detected: Random Number Generator163gitlab # [ 0.009435] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009437] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009440] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009443] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009574] alternatives: applying system-wide alternatives168gitlab # [ 0.012378] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012578] Memory: 5963808K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014046] devtmpfs: initialized171gitlab # [ 0.017971] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018038] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018212] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018216] 0 pages in range for non-PLT usage175gitlab # [ 0.018217] 508288 pages in range for PLT usage176gitlab # [ 0.018329] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019160] DMI not present or invalid.178gitlab # [ 0.022401] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025132] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025399] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027266] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027288] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027616] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028055] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028058] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028063] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028065] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028068] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028147] cpuidle: using governor ladder190gitlab # [ 0.028210] cpuidle: using governor menu191gitlab # [ 0.028419] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028639] ASID allocator initialised with 65536 entries193gitlab # [ 0.029760] Serial: AMBA PL011 UART driver194gitlab # [ 0.034870] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035216] printk: console [ttyAMA0] enabled196gitlab # [ 0.047425] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047447] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047456] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047465] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047473] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047481] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047489] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047497] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058757] fbcon: Taking over console205gitlab # [ 0.058767] ACPI: Interpreter disabled.206gitlab # [ 0.059727] iommu: Default domain type: Translated207gitlab # [ 0.059731] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.068560] SCSI subsystem initialized209gitlab # [ 0.068880] usbcore: registered new interface driver usbfs210gitlab # [ 0.068901] usbcore: registered new interface driver hub211gitlab # [ 0.068925] usbcore: registered new device driver usb212gitlab # [ 0.069168] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.069172] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.069180] PTP clock support registered215gitlab # [ 0.069217] EDAC MC: Ver: 3.0.0216gitlab # [ 0.069592] scmi_core: SCMI protocol bus registered217gitlab # [ 0.070092] FPGA manager framework218gitlab # [ 0.071005] vgaarb: loaded219gitlab # [ 0.072747] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.073210] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.073232] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.073653] netfs: FS-Cache loaded223gitlab # [ 0.073768] pnp: PnP ACPI: disabled224gitlab # [ 0.076813] NET: Registered PF_INET protocol family225gitlab # [ 0.077731] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.105048] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.105098] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.105140] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.105420] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.105973] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.106059] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.106116] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.106227] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.106427] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.106509] NET: Registered PF_XDP protocol family236gitlab # [ 0.106524] PCI: CLS 0 bytes, default 64237gitlab # [ 0.106851] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.120827] kvm [1]: HYP mode not available239gitlab # [ 0.163816] Initialise system trusted keyrings240gitlab # [ 0.163996] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.166206] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.166403] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.205066] Key type asymmetric registered244gitlab # [ 0.205083] Asymmetric key parser 'x509' registered245gitlab # [ 0.205411] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.205817] io scheduler mq-deadline registered247gitlab # [ 0.205829] io scheduler kyber registered248gitlab # [ 0.219848] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.228802] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.229505] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.229530] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.229548] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.229575] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.229609] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.229644] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.229784] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.229798] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.229805] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.229812] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.229818] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.230006] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.230976] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.231387] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.231413] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.231468] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.231493] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.232527] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.232973] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.232997] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.233051] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.234073] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.234474] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.234498] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.234562] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.235573] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.235981] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.236004] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.236058] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.237131] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.237535] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.237559] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.237613] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.238643] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.239055] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.239079] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.239133] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.240151] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.240565] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.240588] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.240647] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.240672] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.241795] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.242217] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.242272] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.243310] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.243726] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.243780] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.244660] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.245125] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.245714] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.246251] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.246275] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.246338] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.247366] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.247779] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.247803] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.247857] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.249119] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.249132] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.249140] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.249227] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.249316] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.249410] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.249500] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.249594] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.249683] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.249786] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.249884] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.249985] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.250110] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.250197] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.250233] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.250269] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.250305] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.250351] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.250399] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.250435] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.250472] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.250509] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.250546] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.250584] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.250623] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.250659] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.250694] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.250730] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.250765] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.250800] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.250845] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.250889] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.250932] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.250970] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.251013] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.251023] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.251030] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.253792] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.287427] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.293430] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.299726] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.306557] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.312398] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.319167] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.325540] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.332480] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.338485] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.344640] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.351607] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.366957] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.371732] msm_serial: driver initialized359gitlab # [ 0.372166] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.372290] STM32 USART driver initialized361gitlab # [ 0.416636] loop: module loaded362gitlab # [ 0.417019] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.421123] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.424521] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.428246] virtio_blk virtio5: [vdb] 12284944 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.432219] megasas: 07.734.00.00-rc1367gitlab # [ 0.433687] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.437334] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.437358] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.440534] Using buffer write method371gitlab # [ 0.440610] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.444404] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.444430] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.449772] Using buffer write method375gitlab # [ 0.449795] Concatenating MTD devices:376gitlab # [ 0.449799] (0): "0.flash"377gitlab # [ 0.449803] (1): "0.flash"378gitlab # [ 0.449807] into device "0.flash"379gitlab # [ 0.548578] Freeing initrd memory: 27184K380gitlab # [ 0.566157] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.575012] thunder_xcv, ver 1.0382gitlab # [ 0.575150] thunder_bgx, ver 1.0383gitlab # [ 0.575210] nicpf, ver 1.0384gitlab # [ 0.576991] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.577004] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.577070] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.577085] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.577179] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.577189] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.577255] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.577265] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.577675] sky2: driver version 1.30393gitlab # [ 0.582693] usbcore: registered new interface driver usb-storage394gitlab # [ 0.582782] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.582828] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.583189] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.583225] usbserial: USB Serial support registered for generic398gitlab # [ 0.583480] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.585148] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.587790] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.587849] rtc-pl031 9010000.pl031: setting system clock to 2026-09-06T15:36:53 UTC (1788709013)402gitlab # [ 0.588830] i2c_dev: i2c /dev entries driver403gitlab # [ 0.592861] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.593748] hub 1-0:1.0: USB hub found405gitlab # [ 0.593896] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.597351] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.597365] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.598167] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.599238] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.603589] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.604293] usbcore: registered new interface driver usbhid412gitlab # [ 0.604303] usbhid: USB HID core driver413gitlab # [ 0.639350] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.644501] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.645036] NET: Registered PF_INET6 protocol family416gitlab # [ 0.647416] Segment Routing with IPv6417gitlab # [ 0.647482] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.647760] NET: Registered PF_PACKET protocol family419gitlab # [ 0.648202] 9pnet: Installing 9P2000 support420gitlab # [ 0.652524] Key type dns_resolver registered421gitlab # [ 0.669352] registered taskstats version 1422gitlab # [ 0.669860] Loading compiled-in X.509 certificates423gitlab # [ 0.687141] Demotion targets for Node 0: null424gitlab # [ 0.687324] Key type .fscrypt registered425gitlab # [ 0.687331] Key type fscrypt-provisioning registered426gitlab # [ 0.687494] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.687518] ima: Allocated hash algorithm: sha1428gitlab # [ 0.687557] ima: No architecture policies found429gitlab # [ 0.688706] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.715183] clk: Disabling unused clocks431gitlab # [ 0.715213] PM: genpd: Disabling unused power domains432gitlab # [ 0.720414] Freeing unused kernel memory: 4736K433gitlab # [ 0.720646] Run /init as init process434gitlab # [ 0.752472] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.860868] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.019889] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.087158] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.087225] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.087292] systemd[1]: Detected architecture arm64.440gitlab # [ 1.087308] systemd[1]: Running in initrd.441gitlab # [ 1.088110] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.088352] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.141526] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.260826] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.334974] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.410850] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.411275] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.414451] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.436063] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.436349] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.436389] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.436405] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.436437] systemd[1]: Reached target Path Units.454gitlab # [ 1.436456] systemd[1]: Reached target Slice Units.455gitlab # [ 1.436478] systemd[1]: Reached target Swaps.456gitlab # [ 1.436497] systemd[1]: Reached target Timer Units.457gitlab # [ 1.436683] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.436993] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.437217] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.437392] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.437495] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.437518] systemd[1]: Reached target Socket Units.463gitlab # [ 1.439477] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.441466] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.441545] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.443458] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.466428] systemd[1]: Starting Journal Service...468gitlab # [ 1.470723] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.470825] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.476883] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.478562] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.479529] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.479870] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.480159] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.485332] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.511308] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.511579] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.511585] [drm] features: -context_init479gitlab # [ 1.513504] [drm] number of scanouts: 1480gitlab # [ 1.513526] [drm] number of cap sets: 0481gitlab # [ 1.514494] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic482gitlab # [ 1.514506] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0483gitlab # [ 1.524951] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.484gitlab # [ 1.525423] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.485gitlab # [ 1.535714] Console: switching to colour frame buffer device 160x50486gitlab # [ 1.537179] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device487gitlab # [ 1.537691] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev488gitlab # [ 1.541014] systemd[1]: Starting Create Static Device Nodes in /dev...489gitlab # [ 1.558565] systemd-journald[95]: Collecting audit messages is disabled.490gitlab # [ 1.569332] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.581129] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.586176] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.589068] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.592349] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.607396] systemd-modules-load[96]: Using 4 probe threads496gitlab # [ 1.613061] systemd[1]: Starting Rule-based Manager for Device Events and Files...497gitlab # [ 1.608584] systemd-modules-load[96]: Module 'virtio_balloon' is built in498gitlab # [ 1.613193] systemd-modules-load[96]: Module 'virtio_console' is built in[ 1.618234] systemd[1]: Started Journal Service.499gitlab # 500gitlab # [ 1.616689] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.617722] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.618666] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.620000] systemd[1]: Finished Apply Kernel Variables.504gitlab # [ 1.646380] systemd[1]: Starting Create System Files and Directories...505gitlab # [ 1.684489] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.688525] systemd-udevd[109]: Using default interface naming scheme 'v261'.507gitlab # [ 1.714538] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.743774] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.807296] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.812168] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.154065] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.156575] systemd[1]: Reached target System Initialization.513gitlab # [ 2.159016] systemd[1]: Reached target Basic System.514gitlab # [ 2.363757] (udev-worker)[142]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.368301] (udev-worker)[142]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.378399] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.401869] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.403194] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.404819] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.411677] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.446552] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.454588] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.474523] systemd[1]: Mounting /sysroot...524gitlab # [ 2.510910] systemd[1]: Mounted /sysroot.525gitlab # [ 2.513093] EXT4-fs (vda): mounted filesystem a96f3112-a1a9-4e60-b80f-ee39ac7a1bd1 r/w with ordered data mode. Quota mode: none.526gitlab # [ 2.512231] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.515888] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.517140] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.518984] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.532109] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.540387] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.542347] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.548245] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.549176] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.556396] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.536gitlab # [ 2.563814] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.565459] systemd[1]: Mounted /sysroot/tmp/xchg.538gitlab # [ 2.571083] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 2.573289] systemd[1]: Reloading...540gitlab # [ 2.745642] erofs (device vdb): mounted with root inode @ nid 128.541gitlab # [ 2.802111] systemd[1]: Reloading finished in 230 ms.542gitlab # [ 2.847624] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...543gitlab # [ 2.848895] systemd[1]: Mounted /sysroot/nix/.ro-store.544gitlab # [ 2.849652] systemd[1]: Mounted /sysroot/tmp/shared.545gitlab # [ 2.850362] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.851344] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.853117] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 2.857342] systemd[1]: initrd-parse-etc.service: Deactivated successfully.549gitlab # [ 2.858434] systemd[1]: Finished Mountpoints Configured in the Real Root.550gitlab # [ 2.859372] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.551gitlab # [ 2.860518] systemd[1]: Starting rw-sysroot-nix-store.service...552gitlab # [ 2.879610] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.881432] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.946123] (udev-worker)[136]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 2.950189] (udev-worker)[136]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 2.953732] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.954743] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.955469] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 2.956315] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.984790] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 2.985926] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 2.986722] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.012239] systemd-vconsole-setup[201]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.014897] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.483269] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.593626] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.596225] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.600861] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.606142] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.680587] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.687172] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.713043] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.715698] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.719847] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.816589] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.819397] systemd[1]: Stopped target Basic System.577gitlab # [ 3.822041] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.824591] systemd[1]: Stopped target Path Units.579gitlab # [ 3.826905] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.830345] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.833749] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.836171] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.838605] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.841741] systemd[1]: Stopped target Swaps.585gitlab # [ 3.844070] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.846465] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.849328] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.852075] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.855470] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.857922] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.860869] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.863502] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.866637] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.871547] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.876426] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.878497] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.885703] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.890065] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.894619] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.896656] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.898144] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.899987] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.903201] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.905141] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.907107] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.909154] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.910668] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.912454] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.914154] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.915978] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.918012] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 3.919858] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 3.936417] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.938868] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.941998] systemd[1]: systemd-udevd.service: Consumed 2.277s CPU time over 2.328s wall clock time, 31.7M memory peak.616gitlab # [ 3.945390] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.947661] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.949513] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.951427] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.954226] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.956098] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.958566] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.960811] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.962753] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.089411] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.093296] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.095800] systemd[1]: Reached target Switch Root.628gitlab # [ 4.100512] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.385529] initrd-nixos-activation-start[226]: booting system configuration /nix/store/dgpn0rpcwcbbr2h92sc4rpkal6frzbvr-nixos-system-gitlab-test630gitlab # [ 4.480185] initrd-nixos-activation-start[226]: running activation script...631gitlab # [ 5.064509] initrd-nixos-activation-start[249]: setting up /etc...632gitlab # [ 5.237731] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 5.241054] systemd[1]: Finished NixOS Activation.634gitlab # [ 5.243179] systemd[1]: initrd-nixos-activation.service: Consumed 1.030s CPU time over 1.136s wall clock time, 37.4M memory peak.635gitlab # [ 5.248123] systemd[1]: Starting Switch Root...636gitlab # [ 5.297081] systemd[1]: Switching root.637gitlab # [ 5.409544] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).638gitlab # [ 6.095713] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)639gitlab # [ 6.095849] systemd[1]: Detected virtualization qemu.640gitlab # [ 6.095934] systemd[1]: Detected architecture arm64.641gitlab # [ 6.096108] systemd[1]: Detected first boot.642gitlab # [ 6.097569] systemd[1]: Initializing machine ID from random generator.643gitlab # [ 6.332923] systemd[1]: bpf-restrict-fs: LSM BPF program attached644gitlab # [ 6.437568] systemd[1]: Applying preset policy.645gitlab # [ 6.610098] systemd[1]: Populated /etc with preset unit settings.646gitlab # [ 6.751692] systemd[1]: initrd-switch-root.service: Deactivated successfully.647gitlab # [ 6.753731] systemd[1]: Stopped initrd-switch-root.service.648gitlab # [ 6.755954] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.649gitlab # [ 6.762510] systemd[1]: Created slice Slice /system/getty.650gitlab # [ 6.765630] systemd[1]: Created slice GitLab DevOps Platform Slice.651gitlab # [ 6.769098] systemd[1]: Created slice User and Session Slice.652gitlab # [ 6.769614] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.653gitlab # [ 6.770362] systemd[1]: Started Forward Password Requests to Wall Directory Watch.654gitlab # [ 6.771074] systemd[1]: Expecting device /dev/hvc0...655gitlab # [ 6.771826] systemd[1]: Expecting device /dev/ttyAMA0...656gitlab # [ 6.772781] systemd[1]: Reached target Local Encrypted Volumes.657gitlab # [ 6.773547] systemd[1]: Stopped target initrd-fs.target.658gitlab # [ 6.774305] systemd[1]: Stopped target initrd-root-fs.target.659gitlab # [ 6.775083] systemd[1]: Stopped target initrd-switch-root.target.660gitlab # [ 6.775877] systemd[1]: Reached target Virtual Machines and Containers.661gitlab # [ 6.776654] systemd[1]: Reached target Path Units.662gitlab # [ 6.778432] systemd[1]: Reached target Remote File Systems.663gitlab # [ 6.779334] systemd[1]: Reached target Slice Units.664gitlab # [ 6.780045] systemd[1]: Reached target Swaps.665gitlab # [ 6.783807] systemd[1]: Listening on Query the User Interactively for a Password.666gitlab # [ 6.788091] systemd[1]: Listening on Process Core Dump Socket.667gitlab # [ 6.791278] systemd[1]: Listening on Credential Encryption/Decryption.668gitlab # [ 6.794976] systemd[1]: Listening on Factory Reset Management.669gitlab # [ 6.796327] systemd[1]: Listening on Hostname Service Socket.670gitlab # [ 6.805726] systemd[1]: Starting Journal Log Access Socket...671gitlab # [ 6.807807] systemd[1]: Listening on Journal Audit Socket.672gitlab # [ 6.809775] systemd[1]: Listening on Console Output Muting Service Socket.673gitlab # [ 6.810340] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.674gitlab # [ 6.810698] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os675gitlab # [ 6.810964] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki676gitlab # [ 6.813316] systemd[1]: Listening on Disk Repartitioning Service Socket.677gitlab # [ 6.813869] systemd[1]: Listening on udev Control Socket.678gitlab # [ 6.814637] systemd[1]: Listening on udev Varlink Socket.679gitlab # [ 6.821722] systemd[1]: Mounting Huge Pages File System...680gitlab # [ 6.826749] systemd[1]: Mounting POSIX Message Queue File System...681gitlab # [ 6.836850] systemd[1]: Mounting Kernel Debug File System...682gitlab # [ 6.846058] systemd[1]: Mounting Kernel Trace File System...683gitlab # [ 6.856917] systemd[1]: Starting Create List of Static Device Nodes...684gitlab # [ 6.873051] systemd[1]: Starting Load Kernel Module 9pnet_virtio...685gitlab # [ 6.874076] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs686gitlab # [ 6.887066] systemd[1]: Mounting Kernel Configuration File System...687gitlab # [ 6.887856] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm688gitlab # [ 6.888606] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore689gitlab # [ 6.901311] systemd[1]: Starting Load Kernel Module fuse...690gitlab # [ 6.902188] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67691gitlab # [ 6.912895] systemd[1]: Starting Journal Service...692gitlab # [ 6.917107] systemd[1]: Starting Load Kernel Modules...693gitlab # [ 6.922148] fuse: init (API version 7.45)694gitlab # [ 6.924324] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...695gitlab # [ 6.931649] systemd[1]: Starting Remount Root and Kernel File Systems...696gitlab # [ 6.936349] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os697gitlab # [ 6.946993] systemd[1]: Starting Coldplug All udev Devices...698gitlab # [ 6.952887] systemd[1]: Listening on Journal Log Access Socket.699gitlab # [ 6.953860] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 6.954746] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 6.955662] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 6.956612] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 6.958068] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 6.959259] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 6.960264] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 6.961158] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 6.962370] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.963363] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.963726] systemd-journald[320]: Collecting audit messages is enabled.710gitlab # [ 6.965442] systemd[1]: Finished Load Kernel Modules.711gitlab # [ 6.973120] systemd[1]: Mounting FUSE Control File System...712gitlab # [ 6.985020] EXT4-fs (vda): re-mounted a96f3112-a1a9-4e60-b80f-ee39ac7a1bd1.713gitlab # [ 6.988379] systemd[1]: Queued start job for default target Multi-User System.714gitlab # [ 6.987460] systemd[1]: Starting Firewall...715gitlab # [ 6.993293] systemd[1]: Unnecessary job was removed for /dev/vdb.716gitlab # [ 6.994514] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 6.995890] systemd-modules-load[321]: Using 3 probe threads718gitlab # [ 6.997092] systemd-modules-load[321]: Module 'atkbd' is built in719gitlab # [ 6.998276] systemd-modules-load[321]: Module 'loop' is built in720gitlab # [ 6.999650] systemd-modules-load[321]: Inserted module 'tls'721gitlab # [ 7.007912] systemd[1]: Starting Apply Kernel Variables...722gitlab # [ 7.013214] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...723gitlab # [ 7.018917] systemd[1]: Started Journal Service.724gitlab # [ 7.017493] systemd[1]: Finished Remount Root and Kernel File Systems.725gitlab # [ 7.020213] systemd[1]: Mounted FUSE Control File System.726gitlab # [ 7.036526] systemd[1]: Finished Apply Kernel Variables.727gitlab # [ 7.038935] systemd-oomd[322]: No swap; memory pressure usage will be degraded728gitlab # [ 7.042411] systemd[1]: Listening on Disk Image Download Service Socket.729gitlab # [ 7.045281] systemd[1]: Starting Flush Journal to Persistent Storage...730gitlab # [ 7.046380] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore731gitlab # [ 7.052646] systemd[1]: Starting Load/Save OS Random Seed...732gitlab # [ 7.053665] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os733gitlab # [ 7.056378] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.734gitlab # [ 7.066080] systemd-journald[320]: Received client request to flush runtime journal.735gitlab # [ 7.089796] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.736gitlab # [ 7.091600] systemd[1]: Starting Create Static Device Nodes in /dev...737gitlab # [ 7.092687] systemd[1]: Finished Load/Save OS Random Seed.738gitlab # [ 7.093686] systemd[1]: Reached target First Boot Complete.739gitlab # [ 7.094484] systemd[1]: Finished Create Static Device Nodes in /dev.740gitlab # [ 7.095424] systemd[1]: Reached target Preparation for Local File Systems.741gitlab # [ 7.096453] systemd[1]: Starting Rule-based Manager for Device Events and Files...742gitlab # [ 7.097607] systemd[1]: Finished Flush Journal to Persistent Storage.743gitlab # [ 7.168559] systemd-udevd[364]: Using default interface naming scheme 'v261'.744gitlab # [ 7.212237] systemd[1]: Started Rule-based Manager for Device Events and Files.745gitlab # [ 7.447114] systemd[1]: Finished Firewall.746gitlab # [ 7.599082] systemd[1]: Finished Coldplug All udev Devices.747gitlab # [ 7.674883] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs748gitlab # [ 7.733425] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.749gitlab # [ 7.758730] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.750gitlab # [ 7.765935] systemd[1]: Mounting /run/wrappers...751gitlab # [ 7.791089] systemd[1]: Mounted /run/wrappers.752gitlab # [ 7.795761] systemd[1]: Reached target Local File Systems.753gitlab # [ 7.796872] systemd[1]: Listening on Boot Loader Control Service Socket.754gitlab # [ 7.798434] systemd[1]: Starting register-nix-paths.service...755gitlab # [ 7.804260] systemd[1]: Starting Create SUID/SGID Wrappers...756gitlab # [ 7.805484] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.757gitlab # [ 7.812236] systemd[1]: Starting Save Transient machine-id to Disk...758gitlab # [ 7.814435] (udev-worker)[431]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.819314] (udev-worker)[418]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.760gitlab # [ 7.823875] (udev-worker)[418]: Network interface NamePolicy= disabled on kernel command line.761gitlab # [ 7.836196] systemd[1]: Starting Create System Files and Directories...762gitlab # [ 7.863326] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.763gitlab # [ 7.866248] systemd[1]: Finished Save Transient machine-id to Disk.764gitlab # [ 7.868963] systemd[1]: Condition check resulted in Virtio network device being skipped.765gitlab # [ 7.870192] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore766gitlab # [ 7.872518] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.767gitlab # [ 7.873932] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67768gitlab # [ 7.877301] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore769gitlab # [ 7.878939] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 7.885813] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os771gitlab # [ 7.888205] systemd[1]: Finished Create System Files and Directories.772gitlab # [ 7.889494] systemd[1]: Starting Rebuild Journal Catalog...773gitlab # [ 7.907995] systemd[1]: Starting Record System Boot/Shutdown in UTMP...774gitlab # [ 7.918055] mousedev: PS/2 mouse device common for all mice775gitlab # [ 7.930058] systemd[1]: Finished Record System Boot/Shutdown in UTMP.776gitlab # [ 7.944653] systemd[1]: Finished Rebuild Journal Catalog.777gitlab # [ 7.945985] systemd[1]: Starting Update is Completed...778gitlab # [ 7.971617] systemd[1]: Finished Update is Completed.779gitlab # [ 8.018839] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.780gitlab # [ 8.020252] systemd[1]: Finished Create SUID/SGID Wrappers.781gitlab # [ 8.021180] systemd[1]: suid-sgid-wrappers.service: Consumed 136ms CPU time over 214ms wall clock time, 6.2M memory peak, 1.9M read from disk.782gitlab # [ 8.265867] systemd[1]: Finished register-nix-paths.service.783gitlab # [ 8.267295] systemd[1]: Reached target System Initialization.784gitlab # [ 8.268226] systemd[1]: Started Discard unused filesystem blocks once a week.785gitlab # [ 8.269755] systemd[1]: Started logrotate.timer.786gitlab # [ 8.270680] systemd[1]: Started Daily Cleanup of Temporary Directories.787gitlab # [ 8.271841] systemd[1]: Reached target Timer Units.788gitlab # [ 8.273157] systemd[1]: Listening on D-Bus System Message Bus Socket.789gitlab # [ 8.274092] systemd[1]: Listening on Nix Daemon Socket.790gitlab # [ 8.285509] systemd[1]: Starting nixbot CI service socket...791gitlab # [ 8.286477] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.792gitlab # [ 8.289477] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 8.290670] systemd[1]: Reached target Socket Units.794gitlab # [ 8.291792] systemd[1]: Starting D-Bus System Message Bus...795gitlab # [ 8.334608] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...796gitlab # [ 8.336203] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'797gitlab # [ 8.337608] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"798gitlab # [ 8.340541] systemd[1]: Started D-Bus System Message Bus.799gitlab # [ 8.346327] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3800gitlab # [ 8.353472] dbus-broker-launch[563]: Ready801gitlab # [ 8.358633] systemd[1]: Reached target Basic System.802gitlab # [ 8.364431] systemd[1]: Started backdoor.service.803gitlab # [ 8.381262] systemd[1]: Starting gitlab-config.service...804gitlab # [ 8.386937] systemd[1]: Starting Import lastlog data into lastlog2 database...805gitlab # [ 8.389226] systemd[1]: Starting Logrotate configuration check...806gitlab # [ 8.393860] systemd[1]: Starting Name Service Cache Daemon (nsncd)...807gitlab # [ 8.400576] systemd[1]: Starting Post-Boot Actions...808gitlab # [ 8.406598] systemd[1]: Started Reset console on configuration changes.809gitlab # [ 8.413816] systemd[1]: Starting resolvconf update...810gitlab # [ 8.426736] logrotate[570]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.811gitlab # [ 8.429691] logrotate[570]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf812gitlab # [ 8.431620] logrotate[570]: note: 'monthly' overrides previously specified 'weekly'813gitlab # connecting to host...814gitlab # [ 8.449580] logrotate[570]: Reading state from file: /var/lib/logrotate.status815gitlab # [ 8.450755] logrotate[570]: state file /var/lib/logrotate.status does not exist816gitlab # [ 8.451859] logrotate[570]: Allocating hash table for state file, size 64 entries817gitlab # [ 8.453172] logrotate[570]: Handling 4 logs818gitlab # [ 8.453757] logrotate[570]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed819gitlab # [ 8.458246] logrotate[570]: considering log /var/log/btmp820gitlab # [ 8.458997] logrotate[570]: Creating new state821gitlab # [ 8.459675] logrotate[570]: Now: 2026-09-06 15:37822gitlab # [ 8.461079] logrotate[570]: Last rotated at 2026-09-06 15:00823gitlab # [ 8.461931] logrotate[570]: log does not need rotating (log has already been rotated)824gitlab # [ 8.464509] logrotate[570]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed825gitlab # [ 8.466872] logrotate[570]: considering log /var/log/wtmp826gitlab # [ 8.467597] logrotate[570]: Creating new state827gitlab: Guest shell says: b'Spawning backdoor root shell...\n'828gitlab # [ 8.468462] logrotate[570]: Now: 2026-09-06 15:37829gitlab # [ 8.471976] logrotate[570]: Last rotated at 2026-09-06 15:00830gitlab # [ 8.472851] logrotate[570]: log does not need rotating (log has already been rotated)831gitlab # [ 8.474756] logrotate[570]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed832gitlab: connected to guest root shell833gitlab # [ 8.476636] logrotate[570]: switching euid from 0 to 165 and egid from 0 to 165 (pid 570)834gitlab: (connecting took 8.94 seconds)835gitlab # [ 8.477820] logrotate[570]: considering log /var/gitlab/state/log/*.log836gitlab: (finished: waiting for the VM to finish booting, in 8.94 seconds)837gitlab # [ 8.478793] logrotate[570]: log /var/gitlab/state/log/*.log does not exist -- skipping838gitlab # [ 8.479777] logrotate[570]: Creating new state839gitlab # [ 8.480366] logrotate[570]: switching euid from 165 to 0 and egid from 165 to 0 (pid 570)840gitlab # [ 8.481481] logrotate[570]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed841gitlab # [ 8.483265] logrotate[570]: switching euid from 0 to 60 and egid from 0 to 60 (pid 570)842gitlab # [ 8.484325] logrotate[570]: considering log /var/log/nginx/*.log843gitlab # [ 8.485044] logrotate[570]: log /var/log/nginx/*.log does not exist -- skipping844gitlab # [ 8.486008] logrotate[570]: Creating new state845gitlab # [ 8.486581] logrotate[570]: not running postrotate script, since no logs were rotated846gitlab # [ 8.487568] logrotate[570]: switching euid from 60 to 0 and egid from 60 to 0 (pid 570)847gitlab # [ 8.490651] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 8.492039] nsncd[571]: Sep 06 15:37:01.371 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"849gitlab # [ 8.495355] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.496585] systemd[1]: Finished Post-Boot Actions.851gitlab # [ 8.497895] systemd[1]: Started Name Service Cache Daemon (nsncd).852gitlab # [ 8.499858] systemd[1]: Reached target Host and Network Name Lookups.853gitlab # [ 8.500977] systemd[1]: Reached target User and Group Name Lookups.854gitlab # [ 8.501975] systemd[1]: Starting User Login Management...855gitlab # [ 8.502733] systemd[1]: Starting Virtual Console Setup...856gitlab # [ 8.525345] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.857gitlab # [ 8.528368] systemd[1]: Stopped Virtual Console Setup.858gitlab # [ 8.530976] systemd[1]: Starting Virtual Console Setup...859gitlab # [ 8.544828] systemd-logind[603]: New seat seat0.860gitlab # [ 8.551425] systemd[1]: Stopped target Host and Network Name Lookups.861gitlab # [ 8.553551] systemd[1]: Stopping Host and Network Name Lookups...862gitlab # [ 8.554522] systemd[1]: Stopped target User and Group Name Lookups.863gitlab # [ 8.555583] systemd[1]: Stopping User and Group Name Lookups...864gitlab # [ 8.556971] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...865gitlab # [ 8.558128] systemd-logind[603]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)866gitlab # [ 8.560731] systemd-logind[603]: Watching system buttons on /dev/input/event0 (gpio-keys)867gitlab # [ 8.562062] systemd[1]: nscd.service: Deactivated successfully.868gitlab # [ 8.563113] systemd[1]: Stopped Name Service Cache Daemon (nsncd).869gitlab # [ 8.564266] systemd[1]: nscd.service: Consumed 20ms CPU time over 160ms wall clock time, 7.4M memory peak, 5.8M read from disk.870gitlab # [ 8.566113] systemd[1]: Started User Login Management.871gitlab # [ 8.570601] systemd[1]: Starting linger-users.service...872gitlab # [ 8.574578] systemd-logind[603]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)873gitlab # [ 8.575829] systemd[1]: Starting Name Service Cache Daemon (nsncd)...874gitlab # [ 8.601215] systemd[1]: Finished resolvconf update.875gitlab # [ 8.603146] systemd-vconsole-setup[652]: Configuration of first virtual console was skipped, ignoring remaining ones.876gitlab # [ 8.604913] systemd[1]: linger-users.service: Deactivated successfully.877gitlab # [ 8.605869] systemd[1]: Finished linger-users.service.878gitlab # [ 8.607231] systemd[1]: Reached target Preparation for Network.879gitlab # [ 8.608589] nsncd[669]: Sep 06 15:37:01.523 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"880gitlab # [ 8.610597] systemd[1]: Starting DHCP Client...881gitlab # [ 8.612774] systemd[1]: Starting Address configuration of eth1...882gitlab # [ 8.616106] systemd[1]: Starting Extra networking commands....883gitlab # [ 8.617588] systemd[1]: Started Name Service Cache Daemon (nsncd).884gitlab # [ 8.620886] systemd[1]: Finished Virtual Console Setup.885gitlab # [ 8.631904] systemd[1]: Reached target Host and Network Name Lookups.886gitlab # [ 8.634663] systemd[1]: Reached target User and Group Name Lookups.887gitlab # [ 8.644782] network-addresses-eth1-start[694]: adding address 192.168.1.1/24... done888gitlab # [ 8.649987] network-addresses-eth1-start[694]: adding address 2001:db8:1::1/64... done889gitlab # [ 8.659605] systemd[1]: Finished Address configuration of eth1.890gitlab # [ 8.692648] dhcpcd[710]: dhcpcd-10.3.2 starting891gitlab # [ 8.696147] dhcpcd[759]: dev: loaded udev892gitlab # [ 8.697167] systemd[1]: Finished Extra networking commands..893gitlab # [ 8.698915] systemd[1]: Reached target Network.894gitlab # [ 8.701772] systemd[1]: Starting gitlab-workhorse.service...895gitlab # [ 8.705124] systemd[1]: Starting Nginx Web Server...896gitlab # [ 8.714165] 8021q: 802.1Q VLAN Support v1.8897gitlab # [ 8.714579] 8021q: adding VLAN 0 to HW filter on device eth1898gitlab # [ 8.715345] systemd[1]: Starting PostgreSQL Server...899gitlab # [ 8.720376] systemd[1]: Starting Redis Server - redis-gitlab...900gitlab # [ 8.728515] systemd[1]: Starting Permit User Sessions...901gitlab # [ 8.737670] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.902gitlab # [ 8.759125] cfg80211: Loading compiled-in X.509 certificates for regulatory database903gitlab # [ 8.765899] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'904gitlab # [ 8.766390] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'905gitlab # [ 8.767839] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2906gitlab # [ 8.768165] cfg80211: failed to load regulatory.db907gitlab # [ 8.772405] systemd[1]: Finished Permit User Sessions.908gitlab # [ 8.780614] systemd[1]: Started Getty on tty1.909gitlab # [ 8.781338] systemd[1]: Reached target Login Prompts.910gitlab # [ 8.811133] 8021q: adding VLAN 0 to HW filter on device eth0911gitlab # [ 8.807638] dhcpcd[759]: eth0: waiting for carrier912gitlab # [ 8.810038] dhcpcd[759]: eth0: carrier acquired913gitlab # [ 8.816493] dhcpcd[759]: DUID 00:01:00:01:32:30:45:1d:52:54:00:12:34:56914gitlab # [ 8.817485] dhcpcd[759]: eth0: IAID 00:12:34:56915gitlab # [ 8.818174] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456916gitlab # [ 8.869772] nginx-pre-start[792]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok917gitlab # [ 8.872229] nginx-pre-start[792]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful918gitlab # [ 8.876590] systemd[1]: Started Nginx Web Server.919gitlab # [ 8.919071] postgresql-pre-start[798]: The files belonging to this database system will be owned by user "postgres".920gitlab # [ 8.920875] postgresql-pre-start[798]: This user must also own the server process.921gitlab # [ 8.922401] postgresql-pre-start[798]: The database cluster will be initialized with locale "en_US.UTF-8".922gitlab # [ 8.923746] postgresql-pre-start[798]: The default database encoding has accordingly been set to "UTF8".923gitlab # [ 8.928116] postgresql-pre-start[798]: The default text search configuration will be set to "english".924gitlab # [ 8.930721] postgresql-pre-start[798]: Data page checksums are enabled.925gitlab # [ 8.931652] postgresql-pre-start[798]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok926gitlab # [ 8.934727] postgresql-pre-start[798]: creating subdirectories ... ok927gitlab # [ 8.935703] postgresql-pre-start[798]: selecting dynamic shared memory implementation ... posix928gitlab # [ 8.937024] systemd[1]: Started Redis Server - redis-gitlab.929gitlab # [ 8.938181] redis-server[795]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.930gitlab # [ 8.940478] redis-server[795]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo931gitlab # [ 8.941559] redis-server[795]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=795, just started932gitlab # [ 8.943023] redis-server[795]: Configuration loaded933gitlab # [ 8.943889] redis[795]: monotonic clock: ARM CNTVCT @ 1000 ticks/us934gitlab # [ 8.944963] redis[795]: Running mode=standalone, port=0.935gitlab # [ 8.945841] redis[795]: Server initialized936gitlab # [ 8.946661] redis[795]: Ready to accept connections unix937gitlab # [ 8.947678] redis[795]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.938gitlab # [ 8.965377] postgresql-pre-start[798]: selecting default "max_connections" ... 100939gitlab # [ 9.026175] postgresql-pre-start[798]: selecting default "shared_buffers" ... 128MB940gitlab # [ 9.308415] systemd[1]: Started gitlab-workhorse.service.941gitlab # [ 9.492844] gitlab-workhorse[821]: time="2026-09-06T15:37:02Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4942gitlab # [ 9.494674] gitlab-workhorse[821]: time="2026-09-06T15:37:02Z" level=info msg="Using redis/go-redis"943gitlab # [ 9.495975] gitlab-workhorse[821]: time="2026-09-06T15:37:02Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix944gitlab # [ 9.518127] postgresql-pre-start[798]: selecting default time zone ... UTC945gitlab # [ 9.522998] postgresql-pre-start[798]: creating configuration files ... ok946gitlab # [ 9.803970] postgresql-pre-start[798]: running bootstrap script ... ok947gitlab # [ 10.267785] dhcpcd[759]: eth0: soliciting a DHCP lease948gitlab # [ 10.284851] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2949gitlab # [ 10.300534] dhcpcd[759]: eth0: probing address 10.0.2.15/24950gitlab # [ 10.469947] postgresql-pre-start[798]: performing post-bootstrap initialization ... ok951gitlab # [ 10.743417] postgresql-pre-start[798]: syncing data to disk ... ok952gitlab # [ 10.746364] postgresql-pre-start[798]: initdb: warning: enabling "trust" authentication for local connections953gitlab # [ 10.750445] postgresql-pre-start[798]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.954gitlab # [ 10.757276] postgresql-pre-start[798]: Success. You can now start the database server using:955gitlab # [ 10.760932] postgresql-pre-start[798]: pg_ctl -D /var/lib/postgresql/18 -l logfile start956gitlab # [ 10.861116] dhcpcd[759]: eth0: soliciting an IPv6 router957gitlab # [ 10.863810] dhcpcd[759]: eth0: Router Advertisement from fe80::2958gitlab # [ 10.866973] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64959gitlab # [ 10.869839] dhcpcd[759]: eth0: adding route to fec0::/64960gitlab # [ 10.872259] dhcpcd[759]: eth0: adding default route via fe80::2961gitlab # [ 10.949663] postgres[855]: [855] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit962gitlab # [ 10.955223] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 5432963gitlab # [ 10.958586] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 5432964gitlab # [ 10.962202] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"965gitlab # [ 10.972318] postgres[864]: [864] LOG: database system was shut down at 2026-09-06 15:37:03 GMT966gitlab # [ 10.988789] postgres[855]: [855] LOG: database system is ready to accept connections967gitlab # [ 10.993696] systemd[1]: Started PostgreSQL Server.968gitlab # [ 11.002124] systemd[1]: Starting PostgreSQL Setup Scripts...969gitlab # [ 11.179227] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: mkdir -p /var/gitlab/state/home/.ssh: OK970gitlab # [ 11.184667] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: chmod 700 /var/gitlab/state/home/.ssh: OK971gitlab # [ 11.261382] systemd[1]: Finished gitlab-config.service.972gitlab # [ 11.265406] systemd[1]: Started gitaly.service.973gitlab # [ 11.398719] postgresql-setup-start[880]: CREATE DATABASE974gitlab # [ 11.453874] postgresql-setup-start[899]: CREATE ROLE975gitlab # [ 11.481980] postgresql-setup-start[901]: ALTER DATABASE976gitlab # [ 11.534659] postgresql-setup-start[911]: CREATE ROLE977gitlab # [ 11.538409] systemd[1]: Finished PostgreSQL Setup Scripts.978gitlab # [ 11.543181] systemd[1]: Reached target PostgreSQL.979gitlab # [ 11.548991] systemd[1]: Starting gitlab-db-config.service...980gitlab # [ 11.558660] systemd[1]: Starting gitlab-postgresql.service...981gitlab # [ 11.752140] gitlab-postgresql-start[923]: CREATE DATABASE982gitlab # [ 11.796953] gitlab-postgresql-start[937]: CREATE EXTENSION983gitlab # [ 11.920118] gitlab-postgresql-start[939]: CREATE EXTENSION984gitlab # [ 11.925974] systemd[1]: Finished gitlab-postgresql.service.985gitlab # [ 11.943184] gitaly[894]: time="2026-09-06T15:37:04.859Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=894986gitlab # [ 11.954100] gitaly[894]: time="2026-09-06T15:37:04.859Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=894987gitlab # [ 11.959463] gitaly[894]: time="2026-09-06T15:37:04.859Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=894988gitlab # [ 11.993794] gitaly[894]: time="2026-09-06T15:37:04.859Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=894989gitlab # [ 11.998746] gitaly[894]: time="2026-09-06T15:37:04.859Z" level=info msg="Starting Gitaly" pid=894 version=990gitlab # [ 12.126495] gitaly[894]: time="2026-09-06T15:37:05.043Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=183 pid=894991gitlab # [ 12.128462] gitaly[894]: time="2026-09-06T15:37:05.044Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=894992gitlab # [ 12.129965] gitaly[894]: time="2026-09-06T15:37:05.044Z" level=info msg="finished initializing command factory" duration_ms=0 pid=894993gitlab # [ 12.131633] gitaly[894]: time="2026-09-06T15:37:05.044Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-894/git-exec-566828147.d/git pid=894994gitlab # [ 12.133952] gitaly[894]: time="2026-09-06T15:37:05.050Z" level=info msg="finished detecting git version" duration_ms=5 pid=894995gitlab # [ 12.135651] gitaly[894]: time="2026-09-06T15:37:05.050Z" level=info msg="using Git version" pid=894 version=2.53.g996gitlab # [ 12.137320] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="clearing disk cache object folder" pid=894 storage=default997gitlab # [ 12.139138] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4036299880 pid=894 storage=default998gitlab # [ 12.141594] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4036299880 pid=894 storage=default999gitlab # [ 12.144251] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8941000gitlab # [ 12.146760] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8941001gitlab # [ 12.149458] gitaly[894]: time="2026-09-06T15:37:05.051Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4036299880 clear_duration_ms=0 pid=894 storage=default1002gitlab # [ 12.160973] gitaly[894]: time="2026-09-06T15:37:05.077Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8941003gitlab # [ 12.164410] gitaly[894]: time="2026-09-06T15:37:05.080Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=894 schema=unix1004gitlab # [ 12.166426] gitaly[894]: time="2026-09-06T15:37:05.080Z" level=info msg="listening at address" address=/run/gitaly/gitaly-894/sock.d/intern pid=894 schema=unix1005gitlab # [ 12.169397] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="finished tempdir cleaner walk" pid=894 storage=default time_ms=01006gitlab # [ 12.171360] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="counting repositories" pid=8941007gitlab # [ 12.173028] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="starting to count repositories" pid=894 storage_path=/var/gitlab/state/repositories1008gitlab # [ 12.174857] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=894 storage_path=/var/gitlab/state/repositories1009gitlab # [ 12.177158] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8941010gitlab # [ 12.178892] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8941011gitlab # [ 12.180770] gitaly[894]: time="2026-09-06T15:37:05.085Z" level=info msg="Started Gitaly" duration_ms=226 pid=8941012gitlab # [ 12.182204] gitaly[894]: time="2026-09-06T15:37:05.086Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8941013gitlab # [ 12.183918] gitaly[894]: time="2026-09-06T15:37:05.086Z" level=info msg="maintenance: daily scheduled" pid=894 scheduled="2026-09-07 12:00:00 +0000 UTC"1014gitlab # [ 12.889837] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1015gitlab # [ 12.900308] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1016gitlab # [ 12.910036] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1017gitlab # [ 15.234413] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds1018gitlab # [ 15.234820] dhcpcd[759]: eth0: adding route to 10.0.2.0/241019gitlab # [ 15.234952] dhcpcd[759]: eth0: adding default route via 10.0.2.21020gitlab # [ 15.423652] systemd[1]: Started DHCP Client.1021gitlab # [ 15.426371] systemd[1]: Reached target Network is Online.1022gitlab # [ 15.487291] gitaly[894]: time="2026-09-06T15:37:08.402Z" level=info msg="License database preloaded" duration_ms=3543 pid=8941023gitlab # [ 58.092964] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: W, [2026-09-06T15:37:51.009105 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1024gitlab # [ 59.567458] gitlab-workhorse[821]: time="2026-09-06T15:37:52Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1025gitlab # [ 61.118288] postgres[1438]: [1438] ERROR: relation "feature_gates" does not exist at character 5231026gitlab # [ 61.118802] postgres[1438]: [1438] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1027gitlab # [ 61.118936] postgres[1438]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1028gitlab # [ 61.119057] postgres[1438]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1029gitlab # [ 61.119175] postgres[1438]: attidentity AS identity,1030gitlab # [ 61.119287] postgres[1438]: attgenerated as attgenerated1031gitlab # [ 61.119398] postgres[1438]: FROM pg_attribute a1032gitlab # [ 61.119511] postgres[1438]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1033gitlab # [ 61.119654] postgres[1438]: LEFT JOIN pg_type t ON a.atttypid = t.oid1034gitlab # [ 61.119768] postgres[1438]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1035gitlab # [ 61.119886] postgres[1438]: WHERE a.attrelid = '"feature_gates"'::regclass1036gitlab # [ 61.119999] postgres[1438]: AND a.attnum > 0 AND NOT a.attisdropped1037gitlab # [ 61.153010] postgres[1438]: ORDER BY a.attnum1038gitlab # [ 61.154470] postgres[1438]:1039gitlab # [ 66.257842] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1489]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1040gitlab # [ 66.258373] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1489]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1041gitlab # [ 69.573648] gitlab-workhorse[821]: time="2026-09-06T15:38:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 79.584243] gitlab-workhorse[821]: time="2026-09-06T15:38:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 89.594324] gitlab-workhorse[821]: time="2026-09-06T15:38:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 92.954206] postgres[1601]: [1601] ERROR: relation "table_without_models" does not exist1045gitlab # [ 92.954630] postgres[1601]: [1601] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1046gitlab # [ 99.600974] gitlab-workhorse[821]: time="2026-09-06T15:38:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047gitlab # [ 109.610216] gitlab-workhorse[821]: time="2026-09-06T15:38:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 119.618336] gitlab-workhorse[821]: time="2026-09-06T15:38:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1049gitlab # [ 122.851444] systemd[1]: Finished gitlab-db-config.service.1050gitlab # [ 122.860204] systemd[1]: Started gitlab-sidekiq.service.1051gitlab # [ 122.866296] systemd[1]: Starting gitlab.service...1052gitlab # [ 123.405490] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1053gitlab # [ 123.411771] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1054gitlab # [ 123.417705] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1055gitlab # [ 127.904536] sidekiq-cluster[1966]: {"severity":"INFO","time":"2026-09-06T15:39:00.790Z","message":"Starting cluster with 1 processes"}1056gitlab # [ 128.018333] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.905Z","pid":1967,"message":"* Enabling systemd notification integration"}1057gitlab # [ 128.023641] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"Puma starting in cluster mode..."}1058gitlab # [ 128.028131] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1059gitlab # [ 128.032861] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1060gitlab # [ 128.038600] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Min threads: 0"}1061gitlab # [ 128.042485] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Max threads: 4"}1062gitlab # [ 128.046443] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Environment: production"}1063gitlab # [ 128.050661] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Master PID: 1967"}1064gitlab # [ 128.054656] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Workers: 2"}1065gitlab # [ 128.058550] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1066gitlab # [ 128.063587] bundle[1967]: {"timestamp":"2026-09-06T15:39:00.934Z","pid":1967,"message":"* Preloading application"}1067gitlab # [ 129.625220] gitlab-workhorse[821]: time="2026-09-06T15:39:02Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 139.625460] gitlab-workhorse[821]: time="2026-09-06T15:39:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 149.636681] gitlab-workhorse[821]: time="2026-09-06T15:39:22Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 159.637734] gitlab-workhorse[821]: time="2026-09-06T15:39:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 165.796438] bundle[1967]: W, [2026-09-06T15:39:38.712316 #1967] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 168.973835] sidekiq-cluster[2011]: 2026-09-06T15:39:41.889Z pid=2011 tid=woj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2011, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431935488}1073gitlab # [ 169.253759] sidekiq-cluster[2011]: W, [2026-09-06T15:39:42.170443 #2011] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1074gitlab # [ 169.319011] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:42.235Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1075gitlab # [ 169.641086] gitlab-workhorse[821]: time="2026-09-06T15:39:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1076gitlab # [ 173.209639] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.125Z","message":"GitLab reliable fetch activated!"}1077gitlab # [ 173.209969] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.125Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1078gitlab # [ 173.243420] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.160Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1079gitlab # [ 173.250584] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.162Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1080gitlab # [ 173.257688] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.165Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1081gitlab # [ 173.264332] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.168Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1082gitlab # [ 173.271588] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.171Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1083gitlab # [ 173.278285] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.174Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1084gitlab # [ 173.284234] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.176Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1085gitlab # [ 173.289438] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.179Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1086gitlab # [ 173.294200] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.181Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1087gitlab # [ 173.298619] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.183Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1088gitlab # [ 173.303257] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.185Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1089gitlab # [ 173.307433] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.187Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1090gitlab # [ 173.311115] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.190Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1091gitlab # [ 173.314858] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.192Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1092gitlab # [ 173.318370] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.194Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1093gitlab # [ 173.321839] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.196Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1094gitlab # [ 173.325873] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.198Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1095gitlab # [ 173.328709] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.201Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1096gitlab # [ 173.331756] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.204Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1097gitlab # [ 173.334907] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.207Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1098gitlab # [ 173.338362] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.210Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1099gitlab # [ 173.341848] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.212Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1100gitlab # [ 173.344875] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.215Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1101gitlab # [ 173.347887] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.217Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1102gitlab # [ 173.351198] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.219Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1103gitlab # [ 173.354271] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.222Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1104gitlab # [ 173.357144] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.224Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1105gitlab # [ 173.360031] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.227Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1106gitlab # [ 173.362964] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.230Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1107gitlab # [ 173.366206] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.232Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1108gitlab # [ 173.368982] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.234Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1109gitlab # [ 173.371906] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.238Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1110gitlab # [ 173.374646] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.240Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1111gitlab # [ 173.377416] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.245Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1112gitlab # [ 173.379945] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.250Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1113gitlab # [ 173.382627] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.255Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1114gitlab # [ 173.385222] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.259Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1115gitlab # [ 173.387583] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.264Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1116gitlab # [ 173.390069] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.269Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1117gitlab # [ 173.392384] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.272Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1118gitlab # [ 173.394741] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.276Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1119gitlab # [ 173.397115] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.280Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1120gitlab # [ 173.399382] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.283Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1121gitlab # [ 173.401638] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.287Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1122gitlab # [ 173.403888] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.291Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1123gitlab # [ 173.406339] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.294Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1124gitlab # [ 173.408516] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.297Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1125gitlab # [ 173.410626] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.300Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1126gitlab # [ 173.412792] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.303Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1127gitlab # [ 173.414893] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.305Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1128gitlab # [ 173.417120] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.308Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1129gitlab # [ 173.419255] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.311Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1130gitlab # [ 173.421498] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.327Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1131gitlab # [ 173.423799] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.331Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1132gitlab # [ 173.429224] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.333Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1133gitlab # [ 173.431426] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.336Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1134gitlab # [ 173.433763] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.341Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1135gitlab # [ 173.435953] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.346Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1136gitlab # [ 173.438260] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.349Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1137gitlab # [ 173.440482] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.353Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1138gitlab # [ 173.442416] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.356Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1139gitlab # [ 173.444676] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.358Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1140gitlab # [ 173.446781] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.362Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1141gitlab # [ 173.449209] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.365Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1142gitlab # [ 173.454969] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.371Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1143gitlab # [ 173.460759] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.377Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1144gitlab # [ 173.465184] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.381Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1145gitlab # [ 173.469582] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.386Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1146gitlab # [ 173.473830] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.390Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1147gitlab # [ 173.479090] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.395Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1148gitlab # [ 173.481559] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.398Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1149gitlab # [ 173.483776] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.400Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1150gitlab # [ 173.486191] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.402Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1151gitlab # [ 173.488549] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.404Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1152gitlab # [ 173.490877] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.407Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1153gitlab # [ 173.493313] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.409Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1154gitlab # [ 173.495522] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.411Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1155gitlab # [ 173.498157] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.413Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 173.500373] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.415Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1157gitlab # [ 173.502507] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.417Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1158gitlab # [ 173.504908] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.419Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1159gitlab # [ 173.507301] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.420Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1160gitlab # [ 173.509705] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.423Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1161gitlab # [ 173.511881] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.425Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1162gitlab # [ 173.514406] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.427Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1163gitlab # [ 173.516658] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.429Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1164gitlab # [ 173.518954] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.432Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1165gitlab # [ 173.521308] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.433Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1166gitlab # [ 173.523587] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.435Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1167gitlab # [ 173.526029] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.437Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1168gitlab # [ 173.529562] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.438Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1169gitlab # [ 173.531773] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.440Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1170gitlab # [ 173.534199] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.442Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1171gitlab # [ 173.536600] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.444Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1172gitlab # [ 173.538544] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.446Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1173gitlab # [ 173.540869] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.448Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1174gitlab # [ 173.543050] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.450Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1175gitlab # [ 173.545362] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.453Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1176gitlab # [ 173.549331] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.466Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1177gitlab # [ 173.551559] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.468Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1178gitlab # [ 173.553892] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.470Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1179gitlab # [ 173.556258] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.473Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1180gitlab # [ 173.558929] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.475Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1181gitlab # [ 173.561487] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.478Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1182gitlab # [ 173.563865] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.480Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1183gitlab # [ 173.566408] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.482Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1184gitlab # [ 173.568559] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.484Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1185gitlab # [ 173.614558] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.529Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1186gitlab # [ 173.617837] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:39:46.534Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1187gitlab # [ 179.643121] gitlab-workhorse[821]: time="2026-09-06T15:39:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 189.650449] gitlab-workhorse[821]: time="2026-09-06T15:40:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 199.660388] gitlab-workhorse[821]: time="2026-09-06T15:40:12Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1190gitlab # [ 209.661427] gitlab-workhorse[821]: time="2026-09-06T15:40:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1191gitlab # [ 213.978801] postgres[2736]: [2736] ERROR: relation "table_without_models" does not exist1192gitlab # [ 213.980477] postgres[2736]: [2736] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1193gitlab # [ 218.076494] postgres[2757]: [2757] ERROR: relation "table_without_models" does not exist1194gitlab # [ 218.079955] postgres[2757]: [2757] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1195gitlab # [ 219.670277] gitlab-workhorse[821]: time="2026-09-06T15:40:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1196gitlab # [ 220.312740] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:33.228Z","message":"Booted Rails 7.2.3.1 application in production environment"}1197gitlab # [ 220.313194] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:33.228Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1198gitlab # [ 220.313326] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:33.228Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1199gitlab # [ 220.313513] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:33.228Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1200gitlab # [ 220.336946] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:33.234Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1201gitlab # [ 223.091411] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:36.006Z","message":"Cleaning working queues"}1202gitlab # [ 223.096394] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:36.009Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"abda207cdbf56a37a083fb0c","created_at":"2026-09-06T15:38:55.145Z","trace_propagation_headers":{"sentry-trace":"60a742f4dbd44b01a9d729e6f72d1c2c-58e50bc1cf0040c3","baggage":"sentry-trace_id=60a742f4dbd44b01a9d729e6f72d1c2c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"15a8857e07d36e025831430977156f9f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:38:55.162Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-abda207cdbf56a37a083fb0c: start","job_status":"start","queue_duration_s":100.847254,"scheduling_latency_s":100.84736}1203gitlab # [ 223.490402] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:36.406Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"abda207cdbf56a37a083fb0c","created_at":"2026-09-06T15:38:55.145Z","trace_propagation_headers":{"sentry-trace":"60a742f4dbd44b01a9d729e6f72d1c2c-58e50bc1cf0040c3","baggage":"sentry-trace_id=60a742f4dbd44b01a9d729e6f72d1c2c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"15a8857e07d36e025831430977156f9f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:38:55.162Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-abda207cdbf56a37a083fb0c: done: 0.396988 sec","job_status":"done","queue_duration_s":100.847254,"scheduling_latency_s":100.84736,"redis_calls":29,"redis_duration_s":0.01244,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.0073,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00323,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21251578000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.396988,"completed_at":"2026-09-06T15:40:36.405Z","load_balancing_strategy":"primary","db_duration_s":0.109915,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1204gitlab # [ 225.614030] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.529Z","pid":1967,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1205gitlab # [ 225.614379] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.529Z","pid":1967,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1206gitlab # [ 225.614571] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.529Z","pid":1967,"message":"! #\u003cThread:0x0000fc782beeb9e8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1207gitlab # [ 225.614742] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.529Z","pid":1967,"message":"! #\u003cThread:0x0000fc782c101b60 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1208gitlab # [ 225.614863] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.530Z","pid":1967,"message":"Use Ctrl-C to stop"}1209gitlab # [ 225.614961] bundle[1967]: {"timestamp":"2026-09-06T15:40:38.530Z","pid":1967,"message":"Sending status to systemd every 1.0 sec"}1210gitlab # [ 228.932180] bundle[1967]: {"timestamp":"2026-09-06T15:40:41.847Z","pid":1967,"message":"- Worker 1 (PID: 2897) booted in 3.26s, phase: 0"}1211gitlab # [ 228.935234] bundle[1967]: {"timestamp":"2026-09-06T15:40:41.851Z","pid":1967,"message":"- Worker 0 (PID: 2893) booted in 3.28s, phase: 0"}1212gitlab # [ 228.939479] systemd[1]: Started gitlab.service.1213gitlab # [ 228.941907] systemd[1]: Reached target Common target for all GitLab services..1214gitlab # [ 228.947017] systemd[1]: Starting setup-gitlab.service...1215gitlab # [ 228.970908] setup-gitlab-start[2948]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1216gitlab # [ 229.909143] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:40:42 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 9071217gitlab # [ 229.913268] setup-gitlab-start[2948]: + TOKEN=nixbot-test-token-of-20-chars1218gitlab # [ 229.916118] setup-gitlab-start[2948]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1219gitlab # [ 229.928994] runuser[2965]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1220gitlab # [ 230.496134] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1221gitlab # [ 230.502761] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1222gitlab # [ 230.509043] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1223gitlab # [ 231.340814] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1224gitlab # [ 231.341152] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1225gitlab # [ 231.343524] setup-gitlab-start[2967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1226gitlab # [ 237.074132] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:49.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"254d7c567e52203fcfe39c37","created_at":"2026-09-06T15:40:49.792Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bafc2984f2479c9ffaf481def44f2393","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:49.981Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-254d7c567e52203fcfe39c37: start","job_status":"start","queue_duration_s":0.007326,"scheduling_latency_s":0.007386}1227gitlab # [ 237.550832] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:50.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"254d7c567e52203fcfe39c37","created_at":"2026-09-06T15:40:49.792Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bafc2984f2479c9ffaf481def44f2393","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:49.981Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-254d7c567e52203fcfe39c37: done: 0.477566 sec","job_status":"done","queue_duration_s":0.007326,"scheduling_latency_s":0.007386,"redis_calls":10,"redis_duration_s":0.034023,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008981,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.022811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005875,"duration_s":0.477566,"completed_at":"2026-09-06T15:40:50.466Z","load_balancing_strategy":"primary","db_duration_s":0.121179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 237.627369] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:50.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6f60d327f76653f4273d8be8","created_at":"2026-09-06T15:40:50.054Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a0aa67d7186d2ad40db023c6bcf4295","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.095Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6f60d327f76653f4273d8be8: start","job_status":"start","queue_duration_s":0.409109,"scheduling_latency_s":0.409165}1229gitlab # [ 237.997674] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:50.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6f60d327f76653f4273d8be8","created_at":"2026-09-06T15:40:50.054Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a0aa67d7186d2ad40db023c6bcf4295","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.095Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6f60d327f76653f4273d8be8: done: 0.409009 sec","job_status":"done","queue_duration_s":0.409109,"scheduling_latency_s":0.409165,"redis_calls":12,"redis_duration_s":0.045359000000000003,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007832,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.02366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00553788,"exclusive_lock_hold_duration_s":0.10188556,"duration_s":0.409009,"completed_at":"2026-09-06T15:40:50.913Z","load_balancing_strategy":"primary","db_duration_s":0.102903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 238.108716] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:51.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"082044998a4308a3577a736a","created_at":"2026-09-06T15:40:50.119Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caefe0c39cedbf6ed80d6f0b1071bf08","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.167Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-082044998a4308a3577a736a: start","job_status":"start","queue_duration_s":0.857115,"scheduling_latency_s":0.857147}1231gitlab # [ 238.590039] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:51.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"082044998a4308a3577a736a","created_at":"2026-09-06T15:40:50.119Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caefe0c39cedbf6ed80d6f0b1071bf08","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.167Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-082044998a4308a3577a736a: done: 0.481108 sec","job_status":"done","queue_duration_s":0.857115,"scheduling_latency_s":0.857147,"redis_calls":16,"redis_duration_s":0.050633,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.035826,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.128,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.128,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059624,"duration_s":0.481108,"completed_at":"2026-09-06T15:40:51.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.178635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 238.675295] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:51.526Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b7f8929049db0d66975ed42b","created_at":"2026-09-06T15:40:50.211Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68268f68e8bf443523906802da66c28f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.260Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b7f8929049db0d66975ed42b: start","job_status":"start","queue_duration_s":1.265009,"scheduling_latency_s":1.265067}1233gitlab # [ 238.992580] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:51.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b7f8929049db0d66975ed42b","created_at":"2026-09-06T15:40:50.211Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68268f68e8bf443523906802da66c28f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.260Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b7f8929049db0d66975ed42b: done: 0.381648 sec","job_status":"done","queue_duration_s":1.265009,"scheduling_latency_s":1.265067,"redis_calls":12,"redis_duration_s":0.057969,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.016535,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.027307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00594092,"duration_s":0.381648,"completed_at":"2026-09-06T15:40:51.907Z","load_balancing_strategy":"primary","db_duration_s":0.025396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 239.109136] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"08f4d5c7f227965bd2b40817","created_at":"2026-09-06T15:40:50.290Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46a411aefc032510a32f190d556dacc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.323Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-08f4d5c7f227965bd2b40817: start","job_status":"start","queue_duration_s":1.700485,"scheduling_latency_s":1.700543}1235gitlab # [ 239.537833] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"08f4d5c7f227965bd2b40817","created_at":"2026-09-06T15:40:50.290Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46a411aefc032510a32f190d556dacc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.323Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-08f4d5c7f227965bd2b40817: done: 0.429489 sec","job_status":"done","queue_duration_s":1.700485,"scheduling_latency_s":1.700543,"redis_calls":12,"redis_duration_s":0.052258,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.021532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.025427,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00699074,"exclusive_lock_hold_duration_s":0.0479081,"duration_s":0.429489,"completed_at":"2026-09-06T15:40:52.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 239.631790] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"10562e9a29b76fc407de6148","created_at":"2026-09-06T15:40:50.352Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62f377310b830ef128fa3d0cda94e10e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.450Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-10562e9a29b76fc407de6148: start","job_status":"start","queue_duration_s":2.02666,"scheduling_latency_s":2.026709}1237gitlab # [ 239.689677] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.606Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1238gitlab # [ 239.755879] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"10562e9a29b76fc407de6148","created_at":"2026-09-06T15:40:50.352Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62f377310b830ef128fa3d0cda94e10e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.450Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-10562e9a29b76fc407de6148: done: 0.194066 sec","job_status":"done","queue_duration_s":2.02666,"scheduling_latency_s":2.026709,"redis_calls":10,"redis_duration_s":0.07546900000000001,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.055974,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.011246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00498846,"duration_s":0.194066,"completed_at":"2026-09-06T15:40:52.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 239.830750] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:52.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ef99ca434d00d1017522bb6e","created_at":"2026-09-06T15:40:50.490Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff253e23f7ff5ea8fe73f225e2f0014f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.575Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ef99ca434d00d1017522bb6e: start","job_status":"start","queue_duration_s":2.124141,"scheduling_latency_s":2.124191}1240gitlab # [ 240.112685] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ef99ca434d00d1017522bb6e","created_at":"2026-09-06T15:40:50.490Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff253e23f7ff5ea8fe73f225e2f0014f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.575Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ef99ca434d00d1017522bb6e: done: 0.327377 sec","job_status":"done","queue_duration_s":2.124141,"scheduling_latency_s":2.124191,"redis_calls":12,"redis_duration_s":0.105857,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.010426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.047714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.047717,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00717116,"exclusive_lock_hold_duration_s":0.02743434,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.327377,"completed_at":"2026-09-06T15:40:53.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029005,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 240.204863] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4931abd6fbfdfb25be0fcfc8","created_at":"2026-09-06T15:40:50.595Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"386e4b58b7c2015c45424271db1962fb","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.628Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4931abd6fbfdfb25be0fcfc8: start","job_status":"start","queue_duration_s":2.430514,"scheduling_latency_s":2.430569}1242gitlab # [ 240.457849] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4931abd6fbfdfb25be0fcfc8","created_at":"2026-09-06T15:40:50.595Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"386e4b58b7c2015c45424271db1962fb","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.628Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4931abd6fbfdfb25be0fcfc8: done: 0.314798 sec","job_status":"done","queue_duration_s":2.430514,"scheduling_latency_s":2.430569,"redis_calls":10,"redis_duration_s":0.024958,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004956,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004826,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00339662,"duration_s":0.314798,"completed_at":"2026-09-06T15:40:53.373Z","load_balancing_strategy":"primary","db_duration_s":0.025019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 240.559207] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"bb80c101dec4beafca2be27e","created_at":"2026-09-06T15:40:50.659Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbf5026bd4b141fd5b8c12cb31afb144","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.719Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-bb80c101dec4beafca2be27e: start","job_status":"start","queue_duration_s":2.667623,"scheduling_latency_s":2.667676}1244gitlab # [ 240.595634] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"bb80c101dec4beafca2be27e","created_at":"2026-09-06T15:40:50.659Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbf5026bd4b141fd5b8c12cb31afb144","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.719Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-bb80c101dec4beafca2be27e: done: 0.124093 sec","job_status":"done","queue_duration_s":2.667623,"scheduling_latency_s":2.667676,"redis_calls":11,"redis_duration_s":0.033165,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005957,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002387,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007374,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0044022,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.124093,"completed_at":"2026-09-06T15:40:53.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 240.667373] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3b6180c510e46e58e9554aa7","created_at":"2026-09-06T15:40:50.753Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f714465e5836b427ac7e2e6e2c54d522","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:40:50.788Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3b6180c510e46e58e9554aa7: start","job_status":"start","queue_duration_s":2.731629,"scheduling_latency_s":2.731682}1246gitlab # [ 240.712997] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.629Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1247gitlab # [ 240.794370] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3b6180c510e46e58e9554aa7","created_at":"2026-09-06T15:40:50.753Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f714465e5836b427ac7e2e6e2c54d522","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:40:50.788Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3b6180c510e46e58e9554aa7: done: 0.189862 sec","job_status":"done","queue_duration_s":2.731629,"scheduling_latency_s":2.731682,"redis_calls":10,"redis_duration_s":0.07577400000000001,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006151,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.065377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00172262,"duration_s":0.189862,"completed_at":"2026-09-06T15:40:53.709Z","load_balancing_strategy":"primary","db_duration_s":0.003233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 240.861402] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2da392dda035bacb16218aa7","created_at":"2026-09-06T15:40:50.823Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e168fc4e262ddcfb7b739ed18ddcc28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.875Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2da392dda035bacb16218aa7: start","job_status":"start","queue_duration_s":2.866294,"scheduling_latency_s":2.866346}1249gitlab # [ 241.001108] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2da392dda035bacb16218aa7","created_at":"2026-09-06T15:40:50.823Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e168fc4e262ddcfb7b739ed18ddcc28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:50.875Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2da392dda035bacb16218aa7: done: 0.175134 sec","job_status":"done","queue_duration_s":2.866294,"scheduling_latency_s":2.866346,"redis_calls":10,"redis_duration_s":0.02419,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004495,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00195428,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.175134,"completed_at":"2026-09-06T15:40:53.916Z","load_balancing_strategy":"primary","db_duration_s":0.037358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 241.087590] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:53.923Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"948bc793e7704630462ed96b","created_at":"2026-09-06T15:40:50.909Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"20d78ef3e2887bc2b25d50d9d3117073","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.067Z","job_size_bytes":3,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-948bc793e7704630462ed96b: start","job_status":"start","queue_duration_s":2.855391,"scheduling_latency_s":2.855443}1251gitlab # [ 241.104049] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.010Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"948bc793e7704630462ed96b","created_at":"2026-09-06T15:40:50.909Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"20d78ef3e2887bc2b25d50d9d3117073","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.067Z","job_size_bytes":3,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-948bc793e7704630462ed96b: done: 0.087493 sec","job_status":"done","queue_duration_s":2.855391,"scheduling_latency_s":2.855443,"redis_calls":10,"redis_duration_s":0.018531,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003978,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00232186,"duration_s":0.087493,"completed_at":"2026-09-06T15:40:54.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 241.148453] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6ca21567a3158d22755e25f0","created_at":"2026-09-06T15:40:51.083Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f59911a8f7053ce05d5110ba044438e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.123Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6ca21567a3158d22755e25f0: start","job_status":"start","queue_duration_s":2.899214,"scheduling_latency_s":2.899259}1253gitlab # [ 241.228889] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6ca21567a3158d22755e25f0","created_at":"2026-09-06T15:40:51.083Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f59911a8f7053ce05d5110ba044438e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.123Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6ca21567a3158d22755e25f0: done: 0.121499 sec","job_status":"done","queue_duration_s":2.899214,"scheduling_latency_s":2.899259,"redis_calls":12,"redis_duration_s":0.037968,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.01117,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.021038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00428276,"duration_s":0.121499,"completed_at":"2026-09-06T15:40:54.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 241.304759] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"215d7631be0d33ef2c73afc1","created_at":"2026-09-06T15:40:51.151Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22ebc3e21341e56483cb3921afbd6ef9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.210Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-215d7631be0d33ef2c73afc1: start","job_status":"start","queue_duration_s":2.949045,"scheduling_latency_s":2.94909}1255gitlab # [ 241.662373] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"215d7631be0d33ef2c73afc1","created_at":"2026-09-06T15:40:51.151Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22ebc3e21341e56483cb3921afbd6ef9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.210Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-215d7631be0d33ef2c73afc1: done: 0.418012 sec","job_status":"done","queue_duration_s":2.949045,"scheduling_latency_s":2.94909,"redis_calls":12,"redis_duration_s":0.032143,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007731,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00293528,"exclusive_lock_hold_duration_s":0.25310888000000004,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.418012,"completed_at":"2026-09-06T15:40:54.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 241.756902] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"71f0ccbd31fd9fb899d09aac","created_at":"2026-09-06T15:40:51.253Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec3677b2aa7241148e2373a7794f09de","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.298Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-71f0ccbd31fd9fb899d09aac: start","job_status":"start","queue_duration_s":3.284294,"scheduling_latency_s":3.284345}1257gitlab # [ 241.869449] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"71f0ccbd31fd9fb899d09aac","created_at":"2026-09-06T15:40:51.253Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec3677b2aa7241148e2373a7794f09de","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.298Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-71f0ccbd31fd9fb899d09aac: done: 0.202411 sec","job_status":"done","queue_duration_s":3.284294,"scheduling_latency_s":3.284345,"redis_calls":13,"redis_duration_s":0.024354,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002161,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.014943,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.099,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.099,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.021947440000000002,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.202411,"completed_at":"2026-09-06T15:40:54.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.098997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1258gitlab # [ 241.943640] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:54.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bbe4ef0d20f17de48776db03","created_at":"2026-09-06T15:40:51.337Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5837a06df9880bf45e09c7157467a385","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.372Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bbe4ef0d20f17de48776db03: start","job_status":"start","queue_duration_s":3.428637,"scheduling_latency_s":3.428693}1259gitlab # [ 242.721880] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bbe4ef0d20f17de48776db03","created_at":"2026-09-06T15:40:51.337Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5837a06df9880bf45e09c7157467a385","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.372Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bbe4ef0d20f17de48776db03: done: 0.835864 sec","job_status":"done","queue_duration_s":3.428637,"scheduling_latency_s":3.428693,"redis_calls":14,"redis_duration_s":0.029501,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.014716,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00398,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.158,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.158,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.500163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00232062,"exclusive_lock_hold_duration_s":0.72577342,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.835864,"completed_at":"2026-09-06T15:40:55.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.31371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 242.816387] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"57207239892cd987182de274","created_at":"2026-09-06T15:40:51.403Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3692e37710e49a93d8231c41f556ea1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.447Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-57207239892cd987182de274: start","job_status":"start","queue_duration_s":4.191361,"scheduling_latency_s":4.191393}1261gitlab # [ 242.829725] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.657Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1262gitlab # [ 242.829791] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"57207239892cd987182de274","created_at":"2026-09-06T15:40:51.403Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3692e37710e49a93d8231c41f556ea1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.447Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-57207239892cd987182de274: done: 0.029274 sec","job_status":"done","queue_duration_s":4.191361,"scheduling_latency_s":4.191393,"redis_calls":10,"redis_duration_s":0.002186,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000378,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036826,"duration_s":0.029274,"completed_at":"2026-09-06T15:40:55.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 243.498085] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"cf7cc285b58dda93b9fabcf4","created_at":"2026-09-06T15:40:51.501Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18abf063586337779e2d68723d033b30","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.554Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-cf7cc285b58dda93b9fabcf4: start","job_status":"start","queue_duration_s":4.115702,"scheduling_latency_s":4.115728}1264gitlab # [ 243.498199] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"cf7cc285b58dda93b9fabcf4","created_at":"2026-09-06T15:40:51.501Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18abf063586337779e2d68723d033b30","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.554Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-cf7cc285b58dda93b9fabcf4: done: 0.039712 sec","job_status":"done","queue_duration_s":4.115702,"scheduling_latency_s":4.115728,"redis_calls":10,"redis_duration_s":0.0017980000000000001,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032182,"duration_s":0.039712,"completed_at":"2026-09-06T15:40:55.709Z","load_balancing_strategy":"primary","db_duration_s":0.007444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 244.144986] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"72eeae5d1d8579b799b8f9e8","created_at":"2026-09-06T15:40:51.581Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.616Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-72eeae5d1d8579b799b8f9e8: start","job_status":"start","queue_duration_s":4.094749,"scheduling_latency_s":4.094771}1266gitlab # [ 244.145265] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"72eeae5d1d8579b799b8f9e8","created_at":"2026-09-06T15:40:51.581Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.616Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-72eeae5d1d8579b799b8f9e8: done: 0.133901 sec","job_status":"done","queue_duration_s":4.094749,"scheduling_latency_s":4.094771,"redis_calls":71,"redis_duration_s":0.020753,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.005785,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.0013,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013101,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032298,"duration_s":0.133901,"completed_at":"2026-09-06T15:40:55.845Z","load_balancing_strategy":"primary","db_duration_s":0.007822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 244.852343] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"242b46b0dd127df84aaed598","created_at":"2026-09-06T15:40:51.651Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b8267f34028cc3a9f5ead31533fc44d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:40:51.700Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-242b46b0dd127df84aaed598: start","job_status":"start","queue_duration_s":4.146813,"scheduling_latency_s":4.146829}1268gitlab # [ 244.874195] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"242b46b0dd127df84aaed598","created_at":"2026-09-06T15:40:51.651Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b8267f34028cc3a9f5ead31533fc44d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:40:51.700Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-242b46b0dd127df84aaed598: done: 0.037518 sec","job_status":"done","queue_duration_s":4.146813,"scheduling_latency_s":4.146829,"redis_calls":10,"redis_duration_s":0.00269,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037084,"duration_s":0.037518,"completed_at":"2026-09-06T15:40:55.884Z","load_balancing_strategy":"primary","db_duration_s":0.007159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 244.929480] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"98eb43a5aabcf772daed9e7e","created_at":"2026-09-06T15:40:51.737Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.792Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-98eb43a5aabcf772daed9e7e: start","job_status":"start","queue_duration_s":4.093972,"scheduling_latency_s":4.09399}1270gitlab # [ 244.944759] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"98eb43a5aabcf772daed9e7e","created_at":"2026-09-06T15:40:51.737Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:51.792Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-98eb43a5aabcf772daed9e7e: done: 0.038572 sec","job_status":"done","queue_duration_s":4.093972,"scheduling_latency_s":4.09399,"redis_calls":19,"redis_duration_s":0.0044599999999999996,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000916,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000345,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002482,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319,"duration_s":0.038572,"completed_at":"2026-09-06T15:40:55.925Z","load_balancing_strategy":"primary","db_duration_s":0.003307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 244.989674] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a22db9477cbdb0e92232936b","created_at":"2026-09-06T15:40:51.869Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f93615d95d87a82376c7dadadd3c3183","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.077Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a22db9477cbdb0e92232936b: start","job_status":"start","queue_duration_s":3.84908,"scheduling_latency_s":3.849096}1272gitlab # [ 245.003681] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a22db9477cbdb0e92232936b","created_at":"2026-09-06T15:40:51.869Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f93615d95d87a82376c7dadadd3c3183","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.077Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a22db9477cbdb0e92232936b: done: 0.039405 sec","job_status":"done","queue_duration_s":3.84908,"scheduling_latency_s":3.849096,"redis_calls":10,"redis_duration_s":0.003101,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00104916,"duration_s":0.039405,"completed_at":"2026-09-06T15:40:55.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 245.046431] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:55.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"f7eba052070b6bea33c1abd3","created_at":"2026-09-06T15:40:52.103Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d14e4b1c03d4ee8e1a2c4b0653e4b192","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.149Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-f7eba052070b6bea33c1abd3: start","job_status":"start","queue_duration_s":3.819353,"scheduling_latency_s":3.81939}1274gitlab # [ 245.061038] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"f7eba052070b6bea33c1abd3","created_at":"2026-09-06T15:40:52.103Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d14e4b1c03d4ee8e1a2c4b0653e4b192","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.149Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-f7eba052070b6bea33c1abd3: done: 0.080748 sec","job_status":"done","queue_duration_s":3.819353,"scheduling_latency_s":3.81939,"redis_calls":13,"redis_duration_s":0.010849000000000001,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002938,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.004959,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073222,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.080748,"completed_at":"2026-09-06T15:40:56.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 245.105173] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"39b3789fbeb045b36e21ae74","created_at":"2026-09-06T15:40:52.218Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1570b9a190596b8aaaca5ac8c62013","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.275Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-39b3789fbeb045b36e21ae74: start","job_status":"start","queue_duration_s":3.78004,"scheduling_latency_s":3.780082}1276gitlab # [ 245.119677] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.085Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1277gitlab # [ 245.123592] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"39b3789fbeb045b36e21ae74","created_at":"2026-09-06T15:40:52.218Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1570b9a190596b8aaaca5ac8c62013","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.275Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-39b3789fbeb045b36e21ae74: done: 0.045251 sec","job_status":"done","queue_duration_s":3.78004,"scheduling_latency_s":3.780082,"redis_calls":10,"redis_duration_s":0.0034279999999999996,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000681,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052588,"duration_s":0.045251,"completed_at":"2026-09-06T15:40:56.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 245.166499] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"fd03717c05c99e276b698752","created_at":"2026-09-06T15:40:52.328Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f59c148c66540034d3e1d5268fb10582","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.373Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-fd03717c05c99e276b698752: start","job_status":"start","queue_duration_s":3.730214,"scheduling_latency_s":3.730244}1279gitlab # [ 245.180163] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"fd03717c05c99e276b698752","created_at":"2026-09-06T15:40:52.328Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f59c148c66540034d3e1d5268fb10582","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.373Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-fd03717c05c99e276b698752: done: 0.038579 sec","job_status":"done","queue_duration_s":3.730214,"scheduling_latency_s":3.730244,"redis_calls":10,"redis_duration_s":0.002738,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043488,"duration_s":0.038579,"completed_at":"2026-09-06T15:40:56.142Z","load_balancing_strategy":"primary","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 245.221045] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"0a0ed54ec3b5512666def42f","created_at":"2026-09-06T15:40:52.409Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eaea594bcc79c02c3a7751736a61b2c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.463Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-0a0ed54ec3b5512666def42f: start","job_status":"start","queue_duration_s":3.680879,"scheduling_latency_s":3.680901}1281gitlab # [ 245.235531] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"0a0ed54ec3b5512666def42f","created_at":"2026-09-06T15:40:52.409Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eaea594bcc79c02c3a7751736a61b2c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.463Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-0a0ed54ec3b5512666def42f: done: 0.039219 sec","job_status":"done","queue_duration_s":3.680879,"scheduling_latency_s":3.680901,"redis_calls":10,"redis_duration_s":0.002735,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004285,"duration_s":0.039219,"completed_at":"2026-09-06T15:40:56.183Z","load_balancing_strategy":"primary","db_duration_s":0.005638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 245.276281] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"94f98fe640997957ac6aa013","created_at":"2026-09-06T15:40:52.512Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc8d2a87f85a955ddae439aac2eaf607","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.589Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-94f98fe640997957ac6aa013: start","job_status":"start","queue_duration_s":3.595773,"scheduling_latency_s":3.595795}1283gitlab # [ 245.290147] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"94f98fe640997957ac6aa013","created_at":"2026-09-06T15:40:52.512Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc8d2a87f85a955ddae439aac2eaf607","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.589Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-94f98fe640997957ac6aa013: done: 0.448838 sec","job_status":"done","queue_duration_s":3.595773,"scheduling_latency_s":3.595795,"redis_calls":565,"redis_duration_s":0.072874,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.071173,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.405748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024138,"duration_s":0.448838,"completed_at":"2026-09-06T15:40:56.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 245.331980] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"e7a1c2019d5e0726b52e9882","created_at":"2026-09-06T15:40:52.614Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.664Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-e7a1c2019d5e0726b52e9882: start","job_status":"start","queue_duration_s":3.97163,"scheduling_latency_s":3.971648}1285gitlab # [ 245.346201] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"e7a1c2019d5e0726b52e9882","created_at":"2026-09-06T15:40:52.614Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.664Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-e7a1c2019d5e0726b52e9882: done: 0.035741 sec","job_status":"done","queue_duration_s":3.97163,"scheduling_latency_s":3.971648,"redis_calls":20,"redis_duration_s":0.0045449999999999996,"redis_read_bytes":23,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001261,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001037,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001811,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032886,"duration_s":0.035741,"completed_at":"2026-09-06T15:40:56.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 245.390055] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9939744e82f3fc4e8ffdc65c","created_at":"2026-09-06T15:40:52.702Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93b805ba87bd64264b301750b447a0f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.736Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9939744e82f3fc4e8ffdc65c: start","job_status":"start","queue_duration_s":3.936728,"scheduling_latency_s":3.936745}1287gitlab # [ 245.405026] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.693Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9939744e82f3fc4e8ffdc65c","created_at":"2026-09-06T15:40:52.702Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93b805ba87bd64264b301750b447a0f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.736Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9939744e82f3fc4e8ffdc65c: done: 0.02031 sec","job_status":"done","queue_duration_s":3.936728,"scheduling_latency_s":3.936745,"redis_calls":10,"redis_duration_s":0.00223,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000441,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032972,"duration_s":0.02031,"completed_at":"2026-09-06T15:40:56.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 245.449162] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"61bddd67372593fcf1c13c29","created_at":"2026-09-06T15:40:52.774Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c30b6d956e0fb40c00cc418c8ca4b8ad","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.806Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-61bddd67372593fcf1c13c29: start","job_status":"start","queue_duration_s":3.888315,"scheduling_latency_s":3.888332}1289gitlab # [ 245.462769] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"61bddd67372593fcf1c13c29","created_at":"2026-09-06T15:40:52.774Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c30b6d956e0fb40c00cc418c8ca4b8ad","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.806Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-61bddd67372593fcf1c13c29: done: 0.054101 sec","job_status":"done","queue_duration_s":3.888315,"scheduling_latency_s":3.888332,"redis_calls":10,"redis_duration_s":0.002546,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044144,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.002842},"duration_s":0.054101,"completed_at":"2026-09-06T15:40:56.748Z","load_balancing_strategy":"primary","db_duration_s":0.022194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 245.505966] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1176a4a426fda93973f2856f","created_at":"2026-09-06T15:40:52.864Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b4c649edd1b72cce93744bd042a1c48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.913Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1176a4a426fda93973f2856f: start","job_status":"start","queue_duration_s":3.836763,"scheduling_latency_s":3.836781}1291gitlab # [ 245.520528] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.775Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1292gitlab # [ 245.524103] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1176a4a426fda93973f2856f","created_at":"2026-09-06T15:40:52.864Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b4c649edd1b72cce93744bd042a1c48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:52.913Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1176a4a426fda93973f2856f: done: 0.045983 sec","job_status":"done","queue_duration_s":3.836763,"scheduling_latency_s":3.836781,"redis_calls":10,"redis_duration_s":0.0057469999999999995,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005733,"duration_s":0.045983,"completed_at":"2026-09-06T15:40:56.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 245.565070] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ff6060118c8d13ddc25b950e","created_at":"2026-09-06T15:40:52.971Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0780cafce493e45f9df0afd28bbf402a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:53.018Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ff6060118c8d13ddc25b950e: start","job_status":"start","queue_duration_s":3.781769,"scheduling_latency_s":3.781812}1294gitlab # [ 245.579303] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ff6060118c8d13ddc25b950e","created_at":"2026-09-06T15:40:52.971Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0780cafce493e45f9df0afd28bbf402a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:53.018Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ff6060118c8d13ddc25b950e: done: 0.142837 sec","job_status":"done","queue_duration_s":3.781769,"scheduling_latency_s":3.781812,"redis_calls":14,"redis_duration_s":0.005727,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001345,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00104336,"exclusive_lock_hold_duration_s":0.09263588,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.142837,"completed_at":"2026-09-06T15:40:56.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 245.623435] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:56.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b03af8c1c30eef6fe766a8a","created_at":"2026-09-06T15:40:53.044Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c04360c59f2d2d7e673db0ea67fe10bd","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:53.074Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b03af8c1c30eef6fe766a8a: start","job_status":"start","queue_duration_s":3.87256,"scheduling_latency_s":3.872608}1296gitlab # [ 245.638085] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b03af8c1c30eef6fe766a8a","created_at":"2026-09-06T15:40:53.044Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c04360c59f2d2d7e673db0ea67fe10bd","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:53.074Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b03af8c1c30eef6fe766a8a: done: 0.054345 sec","job_status":"done","queue_duration_s":3.87256,"scheduling_latency_s":3.872608,"redis_calls":10,"redis_duration_s":0.003722,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00077,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078312,"duration_s":0.054345,"completed_at":"2026-09-06T15:40:57.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 245.681386] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"84aa8f9810bf8186e2ceb74c","created_at":"2026-09-06T15:40:53.097Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5f332ba47bc5fbd6de550239dbebea1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:40:53.194Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-84aa8f9810bf8186e2ceb74c: start","job_status":"start","queue_duration_s":3.81029,"scheduling_latency_s":3.810321}1298gitlab # [ 245.694639] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.025Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1299gitlab # [ 245.698431] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"84aa8f9810bf8186e2ceb74c","created_at":"2026-09-06T15:40:53.097Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5f332ba47bc5fbd6de550239dbebea1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:40:53.194Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-84aa8f9810bf8186e2ceb74c: done: 0.032961 sec","job_status":"done","queue_duration_s":3.81029,"scheduling_latency_s":3.810321,"redis_calls":10,"redis_duration_s":0.003134,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000786,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004747,"duration_s":0.032961,"completed_at":"2026-09-06T15:40:57.037Z","load_balancing_strategy":"primary","db_duration_s":0.000821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 245.739087] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf1866d513abc31f56ce8de9","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf1866d513abc31f56ce8de9: start","job_status":"start","queue_duration_s":1.203876,"scheduling_latency_s":1.203898}1301gitlab # [ 245.751573] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf1866d513abc31f56ce8de9","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf1866d513abc31f56ce8de9: done: 0.031012 sec","job_status":"done","queue_duration_s":1.203876,"scheduling_latency_s":1.203898,"redis_calls":16,"redis_duration_s":0.004334,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002531,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038732,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031012,"completed_at":"2026-09-06T15:40:57.070Z","load_balancing_strategy":"primary","db_duration_s":0.000666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 245.792500] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d96b9a2e36be61b80210cef","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d96b9a2e36be61b80210cef: start","job_status":"start","queue_duration_s":1.236579,"scheduling_latency_s":1.236598}1303gitlab # [ 245.804819] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d96b9a2e36be61b80210cef","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d96b9a2e36be61b80210cef: done: 0.019788 sec","job_status":"done","queue_duration_s":1.236579,"scheduling_latency_s":1.236598,"redis_calls":13,"redis_duration_s":0.0030859999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019788,"completed_at":"2026-09-06T15:40:57.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 245.844750] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f6a6e4fceb1f4a14e6e30e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f6a6e4fceb1f4a14e6e30e: start","job_status":"start","queue_duration_s":1.257899,"scheduling_latency_s":1.257916}1305gitlab # [ 245.882226] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36f6a6e4fceb1f4a14e6e30e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36f6a6e4fceb1f4a14e6e30e: done: 0.020231 sec","job_status":"done","queue_duration_s":1.257899,"scheduling_latency_s":1.257916,"redis_calls":13,"redis_duration_s":0.005389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004365,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020231,"completed_at":"2026-09-06T15:40:57.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 245.955146] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71a74b722e7188b24e7181a","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71a74b722e7188b24e7181a: start","job_status":"start","queue_duration_s":1.2796,"scheduling_latency_s":1.279616}1307gitlab # [ 245.971363] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71a74b722e7188b24e7181a","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71a74b722e7188b24e7181a: done: 0.017234 sec","job_status":"done","queue_duration_s":1.2796,"scheduling_latency_s":1.279616,"redis_calls":13,"redis_duration_s":0.0029119999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017234,"completed_at":"2026-09-06T15:40:57.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 246.015302] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d0c7223427e9b32f984cea","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d0c7223427e9b32f984cea: start","job_status":"start","queue_duration_s":1.298101,"scheduling_latency_s":1.298117}1309gitlab # [ 246.028113] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d0c7223427e9b32f984cea","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d0c7223427e9b32f984cea: done: 0.01661 sec","job_status":"done","queue_duration_s":1.298101,"scheduling_latency_s":1.298117,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01661,"completed_at":"2026-09-06T15:40:57.149Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 246.068489] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e413ac3ab8b56d2647810b","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e413ac3ab8b56d2647810b: start","job_status":"start","queue_duration_s":1.316792,"scheduling_latency_s":1.316808}1311gitlab # [ 246.080690] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e413ac3ab8b56d2647810b","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e413ac3ab8b56d2647810b: done: 0.016513 sec","job_status":"done","queue_duration_s":1.316792,"scheduling_latency_s":1.316808,"redis_calls":13,"redis_duration_s":0.00283,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016513,"completed_at":"2026-09-06T15:40:57.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 246.119920] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c8364bfe5c81dec9cfe8f44","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c8364bfe5c81dec9cfe8f44: start","job_status":"start","queue_duration_s":1.334961,"scheduling_latency_s":1.334977}1313gitlab # [ 246.132569] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c8364bfe5c81dec9cfe8f44","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c8364bfe5c81dec9cfe8f44: done: 0.017017 sec","job_status":"done","queue_duration_s":1.334961,"scheduling_latency_s":1.334977,"redis_calls":13,"redis_duration_s":0.0030600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017017,"completed_at":"2026-09-06T15:40:57.187Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 246.172134] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24a7755e5782d0f0050529e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24a7755e5782d0f0050529e: start","job_status":"start","queue_duration_s":1.353383,"scheduling_latency_s":1.353399}1315gitlab # [ 246.184505] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24a7755e5782d0f0050529e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24a7755e5782d0f0050529e: done: 0.015967 sec","job_status":"done","queue_duration_s":1.353383,"scheduling_latency_s":1.353399,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015967,"completed_at":"2026-09-06T15:40:57.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 246.224114] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53e19a55f17fc59e440d1a67","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53e19a55f17fc59e440d1a67: start","job_status":"start","queue_duration_s":1.370633,"scheduling_latency_s":1.370649}1317gitlab # [ 246.236494] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53e19a55f17fc59e440d1a67","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53e19a55f17fc59e440d1a67: done: 0.016016 sec","job_status":"done","queue_duration_s":1.370633,"scheduling_latency_s":1.370649,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001657,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016016,"completed_at":"2026-09-06T15:40:57.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 246.276589] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44fdb7e9d6388225e5ea9c78","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44fdb7e9d6388225e5ea9c78: start","job_status":"start","queue_duration_s":1.388681,"scheduling_latency_s":1.388698}1319gitlab # [ 246.289078] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44fdb7e9d6388225e5ea9c78","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44fdb7e9d6388225e5ea9c78: done: 0.016142 sec","job_status":"done","queue_duration_s":1.388681,"scheduling_latency_s":1.388698,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016142,"completed_at":"2026-09-06T15:40:57.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 246.328720] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e7f58e7de16072eea29085e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e7f58e7de16072eea29085e: start","job_status":"start","queue_duration_s":1.406212,"scheduling_latency_s":1.406228}1321gitlab # [ 246.340796] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e7f58e7de16072eea29085e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e7f58e7de16072eea29085e: done: 0.016544 sec","job_status":"done","queue_duration_s":1.406212,"scheduling_latency_s":1.406228,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016544,"completed_at":"2026-09-06T15:40:57.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 246.380271] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fd8bde2b7c580528c11de7d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fd8bde2b7c580528c11de7d: start","job_status":"start","queue_duration_s":1.424092,"scheduling_latency_s":1.424107}1323gitlab # [ 246.392583] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fd8bde2b7c580528c11de7d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fd8bde2b7c580528c11de7d: done: 0.016853 sec","job_status":"done","queue_duration_s":1.424092,"scheduling_latency_s":1.424107,"redis_calls":13,"redis_duration_s":0.003265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002341,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016853,"completed_at":"2026-09-06T15:40:57.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 246.431673] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c87cae2febacbc275384e72","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c87cae2febacbc275384e72: start","job_status":"start","queue_duration_s":1.442347,"scheduling_latency_s":1.442364}1325gitlab # [ 246.444234] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c87cae2febacbc275384e72","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c87cae2febacbc275384e72: done: 0.016763 sec","job_status":"done","queue_duration_s":1.442347,"scheduling_latency_s":1.442364,"redis_calls":13,"redis_duration_s":0.002674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016763,"completed_at":"2026-09-06T15:40:57.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 246.484441] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9afaf394921609143d285b6","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9afaf394921609143d285b6: start","job_status":"start","queue_duration_s":1.460589,"scheduling_latency_s":1.460604}1327gitlab # [ 246.496740] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9afaf394921609143d285b6","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9afaf394921609143d285b6: done: 0.016116 sec","job_status":"done","queue_duration_s":1.460589,"scheduling_latency_s":1.460604,"redis_calls":13,"redis_duration_s":0.002756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016116,"completed_at":"2026-09-06T15:40:57.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 246.535940] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dae1f8717cec31e5fd4a564","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dae1f8717cec31e5fd4a564: start","job_status":"start","queue_duration_s":1.478088,"scheduling_latency_s":1.478103}1329gitlab # [ 246.548647] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dae1f8717cec31e5fd4a564","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dae1f8717cec31e5fd4a564: done: 0.016236 sec","job_status":"done","queue_duration_s":1.478088,"scheduling_latency_s":1.478103,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016236,"completed_at":"2026-09-06T15:40:57.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 246.587916] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aaa76bcffed0ffe324b6f58","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aaa76bcffed0ffe324b6f58: start","job_status":"start","queue_duration_s":1.495729,"scheduling_latency_s":1.495744}1331gitlab # [ 246.600473] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aaa76bcffed0ffe324b6f58","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aaa76bcffed0ffe324b6f58: done: 0.015962 sec","job_status":"done","queue_duration_s":1.495729,"scheduling_latency_s":1.495744,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015962,"completed_at":"2026-09-06T15:40:57.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 246.639728] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a512608c24d753c9cb045e99","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a512608c24d753c9cb045e99: start","job_status":"start","queue_duration_s":1.513006,"scheduling_latency_s":1.513021}1333gitlab # [ 246.652415] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a512608c24d753c9cb045e99","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a512608c24d753c9cb045e99: done: 0.016523 sec","job_status":"done","queue_duration_s":1.513006,"scheduling_latency_s":1.513021,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016523,"completed_at":"2026-09-06T15:40:57.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 246.692802] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a525123a6a83b271291c1f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a525123a6a83b271291c1f: start","job_status":"start","queue_duration_s":1.530906,"scheduling_latency_s":1.530921}1335gitlab # [ 246.705250] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a525123a6a83b271291c1f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a525123a6a83b271291c1f: done: 0.016602 sec","job_status":"done","queue_duration_s":1.530906,"scheduling_latency_s":1.530921,"redis_calls":13,"redis_duration_s":0.0032440000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016602,"completed_at":"2026-09-06T15:40:57.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 246.744701] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afc7ac27d40dda30442c16f7","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afc7ac27d40dda30442c16f7: start","job_status":"start","queue_duration_s":1.548843,"scheduling_latency_s":1.548859}1337gitlab # [ 246.757027] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afc7ac27d40dda30442c16f7","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afc7ac27d40dda30442c16f7: done: 0.015662 sec","job_status":"done","queue_duration_s":1.548843,"scheduling_latency_s":1.548859,"redis_calls":13,"redis_duration_s":0.002652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015662,"completed_at":"2026-09-06T15:40:57.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 246.796095] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89f467e7ecf48ffd3395838e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89f467e7ecf48ffd3395838e: start","job_status":"start","queue_duration_s":1.565788,"scheduling_latency_s":1.565804}1339gitlab # [ 246.808486] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89f467e7ecf48ffd3395838e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89f467e7ecf48ffd3395838e: done: 0.016176 sec","job_status":"done","queue_duration_s":1.565788,"scheduling_latency_s":1.565804,"redis_calls":13,"redis_duration_s":0.002829,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016176,"completed_at":"2026-09-06T15:40:57.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 246.848198] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17cc734097d0bac5690debe","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17cc734097d0bac5690debe: start","job_status":"start","queue_duration_s":1.584193,"scheduling_latency_s":1.58421}1341gitlab # [ 246.860558] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17cc734097d0bac5690debe","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17cc734097d0bac5690debe: done: 0.015891 sec","job_status":"done","queue_duration_s":1.584193,"scheduling_latency_s":1.58421,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015891,"completed_at":"2026-09-06T15:40:57.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 246.900099] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b6ddc23a38c0852c54ca8bf","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b6ddc23a38c0852c54ca8bf: start","job_status":"start","queue_duration_s":1.601457,"scheduling_latency_s":1.601473}1343gitlab # [ 246.912167] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b6ddc23a38c0852c54ca8bf","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b6ddc23a38c0852c54ca8bf: done: 0.015617 sec","job_status":"done","queue_duration_s":1.601457,"scheduling_latency_s":1.601473,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015617,"completed_at":"2026-09-06T15:40:57.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 246.950669] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02752d0315d94f3757cf7bd6","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02752d0315d94f3757cf7bd6: start","job_status":"start","queue_duration_s":1.618442,"scheduling_latency_s":1.618458}1345gitlab # [ 246.963043] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02752d0315d94f3757cf7bd6","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02752d0315d94f3757cf7bd6: done: 0.016658 sec","job_status":"done","queue_duration_s":1.618442,"scheduling_latency_s":1.618458,"redis_calls":13,"redis_duration_s":0.002706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016658,"completed_at":"2026-09-06T15:40:57.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 247.001611] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d289c72238549b23acbf2d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d289c72238549b23acbf2d: start","job_status":"start","queue_duration_s":1.636945,"scheduling_latency_s":1.636962}1347gitlab # [ 247.014035] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d289c72238549b23acbf2d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d289c72238549b23acbf2d: done: 0.015013 sec","job_status":"done","queue_duration_s":1.636945,"scheduling_latency_s":1.636962,"redis_calls":13,"redis_duration_s":0.002737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015013,"completed_at":"2026-09-06T15:40:57.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 247.052714] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8abb13a504375426c5a228c2","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8abb13a504375426c5a228c2: start","job_status":"start","queue_duration_s":1.654027,"scheduling_latency_s":1.654044}1349gitlab # [ 247.064902] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8abb13a504375426c5a228c2","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8abb13a504375426c5a228c2: done: 0.016089 sec","job_status":"done","queue_duration_s":1.654027,"scheduling_latency_s":1.654044,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016089,"completed_at":"2026-09-06T15:40:57.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 247.105680] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329f58c235d903bde0e56720","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329f58c235d903bde0e56720: start","job_status":"start","queue_duration_s":1.671498,"scheduling_latency_s":1.671513}1351gitlab # [ 247.118218] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329f58c235d903bde0e56720","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329f58c235d903bde0e56720: done: 0.016244 sec","job_status":"done","queue_duration_s":1.671498,"scheduling_latency_s":1.671513,"redis_calls":13,"redis_duration_s":0.002599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016244,"completed_at":"2026-09-06T15:40:57.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 247.156854] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8425f6692481ecbc145c8ed0","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8425f6692481ecbc145c8ed0: start","job_status":"start","queue_duration_s":1.689076,"scheduling_latency_s":1.689091}1353gitlab # [ 247.169109] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8425f6692481ecbc145c8ed0","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8425f6692481ecbc145c8ed0: done: 0.015302 sec","job_status":"done","queue_duration_s":1.689076,"scheduling_latency_s":1.689091,"redis_calls":13,"redis_duration_s":0.002619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015302,"completed_at":"2026-09-06T15:40:57.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 247.208084] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59698c8a6b177a3381551396","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59698c8a6b177a3381551396: start","job_status":"start","queue_duration_s":1.705714,"scheduling_latency_s":1.70573}1355gitlab # [ 247.220217] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59698c8a6b177a3381551396","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59698c8a6b177a3381551396: done: 0.015613 sec","job_status":"done","queue_duration_s":1.705714,"scheduling_latency_s":1.70573,"redis_calls":13,"redis_duration_s":0.002543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015613,"completed_at":"2026-09-06T15:40:57.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 247.258838] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6959a96deeb3c6f451ee21c","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6959a96deeb3c6f451ee21c: start","job_status":"start","queue_duration_s":1.722589,"scheduling_latency_s":1.722604}1357gitlab # [ 247.271228] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6959a96deeb3c6f451ee21c","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6959a96deeb3c6f451ee21c: done: 0.015562 sec","job_status":"done","queue_duration_s":1.722589,"scheduling_latency_s":1.722604,"redis_calls":13,"redis_duration_s":0.002662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015562,"completed_at":"2026-09-06T15:40:57.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 247.310770] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4dab48c6e717658ae421adb","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4dab48c6e717658ae421adb: start","job_status":"start","queue_duration_s":1.739572,"scheduling_latency_s":1.739588}1359gitlab # [ 247.323201] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4dab48c6e717658ae421adb","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4dab48c6e717658ae421adb: done: 0.015941 sec","job_status":"done","queue_duration_s":1.739572,"scheduling_latency_s":1.739588,"redis_calls":13,"redis_duration_s":0.0033020000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015941,"completed_at":"2026-09-06T15:40:57.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 247.362266] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a754a6466023a263783d406d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a754a6466023a263783d406d: start","job_status":"start","queue_duration_s":1.756828,"scheduling_latency_s":1.756843}1361gitlab # [ 247.374507] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a754a6466023a263783d406d","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a754a6466023a263783d406d: done: 0.015218 sec","job_status":"done","queue_duration_s":1.756828,"scheduling_latency_s":1.756843,"redis_calls":13,"redis_duration_s":0.0026249999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015218,"completed_at":"2026-09-06T15:40:57.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 247.413113] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7f0ee53bc5d121cb949839","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7f0ee53bc5d121cb949839: start","job_status":"start","queue_duration_s":1.773934,"scheduling_latency_s":1.773949}1363gitlab # [ 247.425332] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7f0ee53bc5d121cb949839","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7f0ee53bc5d121cb949839: done: 0.015545 sec","job_status":"done","queue_duration_s":1.773934,"scheduling_latency_s":1.773949,"redis_calls":13,"redis_duration_s":0.003117,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001693,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015545,"completed_at":"2026-09-06T15:40:57.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 247.464299] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c44146d28fc7ad4a20edf39","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c44146d28fc7ad4a20edf39: start","job_status":"start","queue_duration_s":1.790855,"scheduling_latency_s":1.790871}1365gitlab # [ 247.476296] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c44146d28fc7ad4a20edf39","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c44146d28fc7ad4a20edf39: done: 0.015615 sec","job_status":"done","queue_duration_s":1.790855,"scheduling_latency_s":1.790871,"redis_calls":13,"redis_duration_s":0.002637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015615,"completed_at":"2026-09-06T15:40:57.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 247.516107] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06bb26e524e84721fd2743d7","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06bb26e524e84721fd2743d7: start","job_status":"start","queue_duration_s":1.807838,"scheduling_latency_s":1.807854}1367gitlab # [ 247.528343] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06bb26e524e84721fd2743d7","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06bb26e524e84721fd2743d7: done: 0.015324 sec","job_status":"done","queue_duration_s":1.807838,"scheduling_latency_s":1.807854,"redis_calls":13,"redis_duration_s":0.002496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-09-06T15:40:57.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 247.566949] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b89a4038ccc95af00cf238b","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b89a4038ccc95af00cf238b: start","job_status":"start","queue_duration_s":1.824492,"scheduling_latency_s":1.824507}1369gitlab # [ 247.579279] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b89a4038ccc95af00cf238b","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b89a4038ccc95af00cf238b: done: 0.015904 sec","job_status":"done","queue_duration_s":1.824492,"scheduling_latency_s":1.824507,"redis_calls":13,"redis_duration_s":0.003025,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015904,"completed_at":"2026-09-06T15:40:57.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 247.618228] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c8da7055fe42fd7a1fcca26","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c8da7055fe42fd7a1fcca26: start","job_status":"start","queue_duration_s":1.842316,"scheduling_latency_s":1.842332}1371gitlab # [ 247.630523] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c8da7055fe42fd7a1fcca26","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c8da7055fe42fd7a1fcca26: done: 0.015154 sec","job_status":"done","queue_duration_s":1.842316,"scheduling_latency_s":1.842332,"redis_calls":13,"redis_duration_s":0.00233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001511,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015154,"completed_at":"2026-09-06T15:40:57.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 247.668879] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daffb008e1ca9581070c90b4","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daffb008e1ca9581070c90b4: start","job_status":"start","queue_duration_s":1.858868,"scheduling_latency_s":1.858883}1373gitlab # [ 247.681454] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daffb008e1ca9581070c90b4","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daffb008e1ca9581070c90b4: done: 0.015497 sec","job_status":"done","queue_duration_s":1.858868,"scheduling_latency_s":1.858883,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015497,"completed_at":"2026-09-06T15:40:57.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 247.722331] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8503a8ffb96d630fd60281","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8503a8ffb96d630fd60281: start","job_status":"start","queue_duration_s":1.875773,"scheduling_latency_s":1.87579}1375gitlab # [ 247.734788] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8503a8ffb96d630fd60281","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8503a8ffb96d630fd60281: done: 0.015461 sec","job_status":"done","queue_duration_s":1.875773,"scheduling_latency_s":1.87579,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015461,"completed_at":"2026-09-06T15:40:57.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 247.774072] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d978b5428b056125c55aead","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d978b5428b056125c55aead: start","job_status":"start","queue_duration_s":1.893033,"scheduling_latency_s":1.89305}1377gitlab # [ 247.786410] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d978b5428b056125c55aead","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d978b5428b056125c55aead: done: 0.016455 sec","job_status":"done","queue_duration_s":1.893033,"scheduling_latency_s":1.89305,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016455,"completed_at":"2026-09-06T15:40:57.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 247.825098] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebef0753244db1f7592adb3f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebef0753244db1f7592adb3f: start","job_status":"start","queue_duration_s":1.910967,"scheduling_latency_s":1.910983}1379gitlab # [ 247.837898] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebef0753244db1f7592adb3f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebef0753244db1f7592adb3f: done: 0.016013 sec","job_status":"done","queue_duration_s":1.910967,"scheduling_latency_s":1.910983,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016013,"completed_at":"2026-09-06T15:40:57.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 247.876842] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d5a2d94f71922a21cc2919","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d5a2d94f71922a21cc2919: start","job_status":"start","queue_duration_s":1.928354,"scheduling_latency_s":1.928371}1381gitlab # [ 247.889013] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d5a2d94f71922a21cc2919","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d5a2d94f71922a21cc2919: done: 0.016779 sec","job_status":"done","queue_duration_s":1.928354,"scheduling_latency_s":1.928371,"redis_calls":13,"redis_duration_s":0.0032259999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016779,"completed_at":"2026-09-06T15:40:57.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 247.929302] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebd150509a83d5f1eb29ebc1","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebd150509a83d5f1eb29ebc1: start","job_status":"start","queue_duration_s":1.946474,"scheduling_latency_s":1.946491}1383gitlab # [ 247.941636] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebd150509a83d5f1eb29ebc1","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebd150509a83d5f1eb29ebc1: done: 0.020829 sec","job_status":"done","queue_duration_s":1.946474,"scheduling_latency_s":1.946491,"redis_calls":13,"redis_duration_s":0.007030999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004402,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002629,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020829,"completed_at":"2026-09-06T15:40:57.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 247.980471] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02b1ec8ba86e7046a4581877","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02b1ec8ba86e7046a4581877: start","job_status":"start","queue_duration_s":1.9694,"scheduling_latency_s":1.969418}1385gitlab # [ 247.992644] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02b1ec8ba86e7046a4581877","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02b1ec8ba86e7046a4581877: done: 0.016171 sec","job_status":"done","queue_duration_s":1.9694,"scheduling_latency_s":1.969418,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001564,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016171,"completed_at":"2026-09-06T15:40:57.820Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 248.031818] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5513a332af8819e5bfddee2f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5513a332af8819e5bfddee2f: start","job_status":"start","queue_duration_s":1.98679,"scheduling_latency_s":1.986805}1387gitlab # [ 248.044280] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5513a332af8819e5bfddee2f","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5513a332af8819e5bfddee2f: done: 0.019497 sec","job_status":"done","queue_duration_s":1.98679,"scheduling_latency_s":1.986805,"redis_calls":13,"redis_duration_s":0.005474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019497,"completed_at":"2026-09-06T15:40:57.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 248.082932] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed29dbde119781c94eb26b8","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed29dbde119781c94eb26b8: start","job_status":"start","queue_duration_s":2.007552,"scheduling_latency_s":2.007568}1389gitlab # [ 248.095107] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed29dbde119781c94eb26b8","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed29dbde119781c94eb26b8: done: 0.017514 sec","job_status":"done","queue_duration_s":2.007552,"scheduling_latency_s":2.007568,"redis_calls":13,"redis_duration_s":0.003583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017514,"completed_at":"2026-09-06T15:40:57.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 248.134335] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be79cde3ba56ed4a3a7bc9e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be79cde3ba56ed4a3a7bc9e: start","job_status":"start","queue_duration_s":2.026908,"scheduling_latency_s":2.026926}1391gitlab # [ 248.146506] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be79cde3ba56ed4a3a7bc9e","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be79cde3ba56ed4a3a7bc9e: done: 0.017407 sec","job_status":"done","queue_duration_s":2.026908,"scheduling_latency_s":2.026926,"redis_calls":13,"redis_duration_s":0.0033150000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017407,"completed_at":"2026-09-06T15:40:57.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 248.184513] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329858e5df74f888a067a595","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329858e5df74f888a067a595: start","job_status":"start","queue_duration_s":2.04571,"scheduling_latency_s":2.045727}1393gitlab # [ 248.196514] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329858e5df74f888a067a595","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329858e5df74f888a067a595: done: 0.016222 sec","job_status":"done","queue_duration_s":2.04571,"scheduling_latency_s":2.045727,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016222,"completed_at":"2026-09-06T15:40:57.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 248.234958] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d93d6b6952417da5c61499f0","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d93d6b6952417da5c61499f0: start","job_status":"start","queue_duration_s":2.063403,"scheduling_latency_s":2.06342}1395gitlab # [ 248.247144] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d93d6b6952417da5c61499f0","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d93d6b6952417da5c61499f0: done: 0.017711 sec","job_status":"done","queue_duration_s":2.063403,"scheduling_latency_s":2.06342,"redis_calls":13,"redis_duration_s":0.004176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017711,"completed_at":"2026-09-06T15:40:57.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 248.285610] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dcaf3c4b74b8dbdcbc6b2e3","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dcaf3c4b74b8dbdcbc6b2e3: start","job_status":"start","queue_duration_s":2.082485,"scheduling_latency_s":2.082502}1397gitlab # [ 248.297510] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dcaf3c4b74b8dbdcbc6b2e3","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dcaf3c4b74b8dbdcbc6b2e3: done: 0.01604 sec","job_status":"done","queue_duration_s":2.082485,"scheduling_latency_s":2.082502,"redis_calls":13,"redis_duration_s":0.002602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01604,"completed_at":"2026-09-06T15:40:57.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 248.336634] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0dd8e2723c0a5a65ed0ce39","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0dd8e2723c0a5a65ed0ce39: start","job_status":"start","queue_duration_s":2.101798,"scheduling_latency_s":2.101817}1399gitlab # [ 248.348723] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0dd8e2723c0a5a65ed0ce39","created_at":"2026-09-06T15:40:55.743Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-216b32d39a394c55","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9ce75befd011ff4ca43e3f51fb7f018f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.835Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0dd8e2723c0a5a65ed0ce39: done: 0.024134 sec","job_status":"done","queue_duration_s":2.101798,"scheduling_latency_s":2.101817,"redis_calls":13,"redis_duration_s":0.010121999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024134,"completed_at":"2026-09-06T15:40:57.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 248.386657] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.962Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ef4d7bf95a240f97f3be02d","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ef4d7bf95a240f97f3be02d: start","job_status":"start","queue_duration_s":2.045508,"scheduling_latency_s":2.045525}1401gitlab # [ 248.398752] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.982Z","message":"No existing merge request to be cleaned up."}1402gitlab # [ 248.400416] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.997Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ef4d7bf95a240f97f3be02d","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ef4d7bf95a240f97f3be02d: done: 0.03506 sec","job_status":"done","queue_duration_s":2.045508,"scheduling_latency_s":2.045525,"redis_calls":13,"redis_duration_s":0.004013,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037622,"duration_s":0.03506,"completed_at":"2026-09-06T15:40:57.997Z","load_balancing_strategy":"primary","db_duration_s":0.004523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 248.440173] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:57.999Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6406c5d76c6ddb18ea1712dc","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6406c5d76c6ddb18ea1712dc: start","job_status":"start","queue_duration_s":2.082183,"scheduling_latency_s":2.082202}1404gitlab # [ 248.452549] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.012Z","message":"No existing merge request to be cleaned up."}1405gitlab # [ 248.454202] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.022Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6406c5d76c6ddb18ea1712dc","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6406c5d76c6ddb18ea1712dc: done: 0.023379 sec","job_status":"done","queue_duration_s":2.082183,"scheduling_latency_s":2.082202,"redis_calls":10,"redis_duration_s":0.00283,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023379,"completed_at":"2026-09-06T15:40:58.022Z","load_balancing_strategy":"primary","db_duration_s":0.00326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 248.492753] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.024Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c9449c6640dc86a5cae42151","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c9449c6640dc86a5cae42151: start","job_status":"start","queue_duration_s":2.107099,"scheduling_latency_s":2.107117}1407gitlab # [ 248.504863] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.037Z","message":"No existing merge request to be cleaned up."}1408gitlab # [ 248.506505] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.047Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c9449c6640dc86a5cae42151","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c9449c6640dc86a5cae42151: done: 0.0231 sec","job_status":"done","queue_duration_s":2.107099,"scheduling_latency_s":2.107117,"redis_calls":10,"redis_duration_s":0.002784,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0231,"completed_at":"2026-09-06T15:40:58.047Z","load_balancing_strategy":"primary","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 248.546314] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.049Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"afeda8806e9e149f171c766f","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-afeda8806e9e149f171c766f: start","job_status":"start","queue_duration_s":2.131911,"scheduling_latency_s":2.13193}1410gitlab # [ 248.558721] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.061Z","message":"No existing merge request to be cleaned up."}1411gitlab # [ 248.560402] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.070Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"afeda8806e9e149f171c766f","created_at":"2026-09-06T15:40:55.903Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-735b8c07b9244e30","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"43945ccacbae11f4e3a662ab65fffbc0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:40:55.917Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-afeda8806e9e149f171c766f: done: 0.021393 sec","job_status":"done","queue_duration_s":2.131911,"scheduling_latency_s":2.13193,"redis_calls":10,"redis_duration_s":0.002608,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021393,"completed_at":"2026-09-06T15:40:58.070Z","load_balancing_strategy":"primary","db_duration_s":0.002843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 248.598750] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.072Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"fb437caf56600aed85a9fb2e","created_at":"2026-09-06T15:40:56.647Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-6f900e2b37624d0b","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:56.657Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-fb437caf56600aed85a9fb2e: start","job_status":"start","queue_duration_s":1.414798,"scheduling_latency_s":1.414815}1413gitlab # [ 248.614000] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.102Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"fb437caf56600aed85a9fb2e","created_at":"2026-09-06T15:40:56.647Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-6f900e2b37624d0b","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:56.657Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-fb437caf56600aed85a9fb2e: done: 0.030247 sec","job_status":"done","queue_duration_s":1.414798,"scheduling_latency_s":1.414815,"redis_calls":10,"redis_duration_s":0.003444,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000651,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049914,"duration_s":0.030247,"completed_at":"2026-09-06T15:40:58.102Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 248.656918] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.103Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"00b0f4e91a402b4a4e2b04d4","created_at":"2026-09-06T15:40:56.658Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-6f900e2b37624d0b","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:56.663Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-00b0f4e91a402b4a4e2b04d4: start","job_status":"start","queue_duration_s":1.440534,"scheduling_latency_s":1.44055}1415gitlab # [ 248.671817] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:40:58.126Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"00b0f4e91a402b4a4e2b04d4","created_at":"2026-09-06T15:40:56.658Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-6f900e2b37624d0b","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"33af069692d9b4c55dff648a4524659f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-06T15:40:56.663Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-00b0f4e91a402b4a4e2b04d4: done: 0.022472 sec","job_status":"done","queue_duration_s":1.440534,"scheduling_latency_s":1.44055,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033928,"duration_s":0.022472,"completed_at":"2026-09-06T15:40:58.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 253.604380] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:06.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0164ac64e78a0b6f3d2424e","created_at":"2026-09-06T15:41:06.492Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33ff88215101fd714c6c7b6d1d65548e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.510Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0164ac64e78a0b6f3d2424e: start","job_status":"start","queue_duration_s":0.006903,"scheduling_latency_s":0.007013}1417gitlab # [ 254.000565] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:06.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d0164ac64e78a0b6f3d2424e","created_at":"2026-09-06T15:41:06.492Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33ff88215101fd714c6c7b6d1d65548e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.510Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d0164ac64e78a0b6f3d2424e: done: 0.399021 sec","job_status":"done","queue_duration_s":0.006903,"scheduling_latency_s":0.007013,"redis_calls":9,"redis_duration_s":0.056572000000000004,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.03697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.019602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00878274,"exclusive_lock_hold_duration_s":0.06771182,"duration_s":0.399021,"completed_at":"2026-09-06T15:41:06.915Z","load_balancing_strategy":"primary","db_duration_s":0.047286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 254.092227] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:06.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"722cb7a04e7d70d99df7503c","created_at":"2026-09-06T15:41:06.548Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6ea9557f899502d0726d4746ea29609","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.574Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-722cb7a04e7d70d99df7503c: start","job_status":"start","queue_duration_s":0.365244,"scheduling_latency_s":0.365304}1419gitlab # [ 254.153528] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"722cb7a04e7d70d99df7503c","created_at":"2026-09-06T15:41:06.548Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6ea9557f899502d0726d4746ea29609","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.574Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-722cb7a04e7d70d99df7503c: done: 0.129239 sec","job_status":"done","queue_duration_s":0.365244,"scheduling_latency_s":0.365304,"redis_calls":7,"redis_duration_s":0.032292,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.018883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.013409,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.129239,"completed_at":"2026-09-06T15:41:07.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 254.239554] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c8e53f9a1e7f32818908a1c6","created_at":"2026-09-06T15:41:06.713Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee209be4c4f794f6c92b829c1f1f7c18","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.757Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c8e53f9a1e7f32818908a1c6: start","job_status":"start","queue_duration_s":0.32274,"scheduling_latency_s":0.322794}1421gitlab # [ 254.257598] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.122Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1422gitlab # [ 254.261138] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c8e53f9a1e7f32818908a1c6","created_at":"2026-09-06T15:41:06.713Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee209be4c4f794f6c92b829c1f1f7c18","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.757Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c8e53f9a1e7f32818908a1c6: done: 0.073557 sec","job_status":"done","queue_duration_s":0.32274,"scheduling_latency_s":0.322794,"redis_calls":7,"redis_duration_s":0.01449,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073557,"completed_at":"2026-09-06T15:41:07.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 254.303865] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2e18c1630213746ea3f7d5a3","created_at":"2026-09-06T15:41:06.853Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7e3e76d8d7bf23c749a90b669f55db7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.864Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2e18c1630213746ea3f7d5a3: start","job_status":"start","queue_duration_s":0.298041,"scheduling_latency_s":0.298092}1424gitlab # [ 254.356105] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2e18c1630213746ea3f7d5a3","created_at":"2026-09-06T15:41:06.853Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7e3e76d8d7bf23c749a90b669f55db7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.864Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2e18c1630213746ea3f7d5a3: done: 0.109399 sec","job_status":"done","queue_duration_s":0.298041,"scheduling_latency_s":0.298092,"redis_calls":9,"redis_duration_s":0.023323,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.018278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00152976,"exclusive_lock_hold_duration_s":0.01511174,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.109399,"completed_at":"2026-09-06T15:41:07.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 254.419147] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bbcd46f3974a62237c07b2fa","created_at":"2026-09-06T15:41:06.894Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59190465048ebdddf778990e02e53a02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:41:06.907Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bbcd46f3974a62237c07b2fa: start","job_status":"start","queue_duration_s":0.371217,"scheduling_latency_s":0.371268}1426gitlab # [ 254.479217] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.395Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1427gitlab # [ 254.547638] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bbcd46f3974a62237c07b2fa","created_at":"2026-09-06T15:41:06.894Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59190465048ebdddf778990e02e53a02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:41:06.907Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bbcd46f3974a62237c07b2fa: done: 0.184128 sec","job_status":"done","queue_duration_s":0.371217,"scheduling_latency_s":0.371268,"redis_calls":7,"redis_duration_s":0.053200000000000004,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.051186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.184128,"completed_at":"2026-09-06T15:41:07.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 254.631998] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f53b6bc1c8c045df59bf7e93","created_at":"2026-09-06T15:41:06.928Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"443a48af78ed7f506595a0c80ccc8f8d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.938Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f53b6bc1c8c045df59bf7e93: start","job_status":"start","queue_duration_s":0.574352,"scheduling_latency_s":0.574404}1429gitlab # [ 254.694041] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f53b6bc1c8c045df59bf7e93","created_at":"2026-09-06T15:41:06.928Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"443a48af78ed7f506595a0c80ccc8f8d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.938Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f53b6bc1c8c045df59bf7e93: done: 0.09736 sec","job_status":"done","queue_duration_s":0.574352,"scheduling_latency_s":0.574404,"redis_calls":7,"redis_duration_s":0.003231,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.09736,"completed_at":"2026-09-06T15:41:07.609Z","load_balancing_strategy":"primary","db_duration_s":0.003692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 254.782865] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f837c1ed78c906d487f3bc2","created_at":"2026-09-06T15:41:06.975Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90f081f618dcd9d016c59e0a44a5880e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.991Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f837c1ed78c906d487f3bc2: start","job_status":"start","queue_duration_s":0.621251,"scheduling_latency_s":0.621299}1431gitlab # [ 254.805245] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f837c1ed78c906d487f3bc2","created_at":"2026-09-06T15:41:06.975Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90f081f618dcd9d016c59e0a44a5880e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:06.991Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f837c1ed78c906d487f3bc2: done: 0.031576 sec","job_status":"done","queue_duration_s":0.621251,"scheduling_latency_s":0.621299,"redis_calls":7,"redis_duration_s":0.002421,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031576,"completed_at":"2026-09-06T15:41:07.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 254.850671] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a6734d8de9f88f7a321c8145","created_at":"2026-09-06T15:41:07.019Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f8a8807129da9da87f1e6db3d4e25f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.025Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a6734d8de9f88f7a321c8145: start","job_status":"start","queue_duration_s":0.62137,"scheduling_latency_s":0.621404}1433gitlab # [ 254.865512] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a6734d8de9f88f7a321c8145","created_at":"2026-09-06T15:41:07.019Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f8a8807129da9da87f1e6db3d4e25f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.025Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a6734d8de9f88f7a321c8145: done: 0.071609 sec","job_status":"done","queue_duration_s":0.62137,"scheduling_latency_s":0.621404,"redis_calls":9,"redis_duration_s":0.0045590000000000006,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002562,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00141406,"exclusive_lock_hold_duration_s":0.02842784,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071609,"completed_at":"2026-09-06T15:41:07.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 254.908528] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e114f62c4b1cafa2662abc7b","created_at":"2026-09-06T15:41:07.061Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7b4e8dc8fc15672feeab7e88a28414","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.075Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e114f62c4b1cafa2662abc7b: start","job_status":"start","queue_duration_s":0.647022,"scheduling_latency_s":0.647074}1435gitlab # [ 254.922777] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e114f62c4b1cafa2662abc7b","created_at":"2026-09-06T15:41:07.061Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7b4e8dc8fc15672feeab7e88a28414","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.075Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e114f62c4b1cafa2662abc7b: done: 0.047631 sec","job_status":"done","queue_duration_s":0.647022,"scheduling_latency_s":0.647074,"redis_calls":10,"redis_duration_s":0.0038599999999999997,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002446,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00963054,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.047631,"completed_at":"2026-09-06T15:41:07.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1436gitlab # [ 254.966720] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:07.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"487d6631f8e64c0727381b12","created_at":"2026-09-06T15:41:07.104Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42e5c24365c9a0ab461d7f276b895d12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.115Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-487d6631f8e64c0727381b12: start","job_status":"start","queue_duration_s":0.656746,"scheduling_latency_s":0.65678}1437gitlab # [ 255.240549] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"487d6631f8e64c0727381b12","created_at":"2026-09-06T15:41:07.104Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42e5c24365c9a0ab461d7f276b895d12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.115Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-487d6631f8e64c0727381b12: done: 0.384474 sec","job_status":"done","queue_duration_s":0.656746,"scheduling_latency_s":0.65678,"redis_calls":9,"redis_duration_s":0.002373,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.058,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.313227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067664,"exclusive_lock_hold_duration_s":0.3625873,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.384474,"completed_at":"2026-09-06T15:41:08.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 255.336379] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"118e20a37fabc98e29803837","created_at":"2026-09-06T15:41:07.137Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdbdea755bfe4a3615df8eb77d7174b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.149Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-118e20a37fabc98e29803837: start","job_status":"start","queue_duration_s":1.008706,"scheduling_latency_s":1.00873}1439gitlab # [ 255.354591] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.167Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1440gitlab # [ 255.358516] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"118e20a37fabc98e29803837","created_at":"2026-09-06T15:41:07.137Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdbdea755bfe4a3615df8eb77d7174b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.149Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-118e20a37fabc98e29803837: done: 0.015306 sec","job_status":"done","queue_duration_s":1.008706,"scheduling_latency_s":1.00873,"redis_calls":7,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015306,"completed_at":"2026-09-06T15:41:08.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 255.401139] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"514640d5994864e09edd262e","created_at":"2026-09-06T15:41:07.170Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.176Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-514640d5994864e09edd262e: start","job_status":"start","queue_duration_s":0.999172,"scheduling_latency_s":0.999192}1442gitlab # [ 255.414620] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"514640d5994864e09edd262e","created_at":"2026-09-06T15:41:07.170Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.176Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-514640d5994864e09edd262e: done: 0.09581 sec","job_status":"done","queue_duration_s":0.999172,"scheduling_latency_s":0.999192,"redis_calls":60,"redis_duration_s":0.015269999999999999,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001336,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013222,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09581,"completed_at":"2026-09-06T15:41:08.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 255.455842] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"40355b0a59135a1ff61b78d9","created_at":"2026-09-06T15:41:07.213Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e280bdbf2065c77197d1c1d39632e179","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:41:07.230Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-40355b0a59135a1ff61b78d9: start","job_status":"start","queue_duration_s":1.04254,"scheduling_latency_s":1.04256}1444gitlab # [ 255.468840] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"40355b0a59135a1ff61b78d9","created_at":"2026-09-06T15:41:07.213Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e280bdbf2065c77197d1c1d39632e179","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:41:07.230Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-40355b0a59135a1ff61b78d9: done: 0.021953 sec","job_status":"done","queue_duration_s":1.04254,"scheduling_latency_s":1.04256,"redis_calls":7,"redis_duration_s":0.001768,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021953,"completed_at":"2026-09-06T15:41:08.294Z","load_balancing_strategy":"primary","db_duration_s":0.001835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 255.508199] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e94082894c59168dea25f155","created_at":"2026-09-06T15:41:07.256Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.268Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e94082894c59168dea25f155: start","job_status":"start","queue_duration_s":1.027988,"scheduling_latency_s":1.028009}1446gitlab # [ 255.521626] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e94082894c59168dea25f155","created_at":"2026-09-06T15:41:07.256Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.268Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e94082894c59168dea25f155: done: 0.120212 sec","job_status":"done","queue_duration_s":1.027988,"scheduling_latency_s":1.028009,"redis_calls":14,"redis_duration_s":0.003416,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002271,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120212,"completed_at":"2026-09-06T15:41:08.416Z","load_balancing_strategy":"primary","db_duration_s":0.001059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 255.565430] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26126e839d6cb2f900c232a5","created_at":"2026-09-06T15:41:07.318Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57d8079ded30a129b1ed6fbfe60c8cea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.323Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26126e839d6cb2f900c232a5: start","job_status":"start","queue_duration_s":1.094665,"scheduling_latency_s":1.094689}1448gitlab # [ 255.579557] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26126e839d6cb2f900c232a5","created_at":"2026-09-06T15:41:07.318Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57d8079ded30a129b1ed6fbfe60c8cea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.323Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26126e839d6cb2f900c232a5: done: 0.016846 sec","job_status":"done","queue_duration_s":1.094665,"scheduling_latency_s":1.094689,"redis_calls":7,"redis_duration_s":0.001091,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016846,"completed_at":"2026-09-06T15:41:08.434Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 255.620929] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"38fc5918410678aed6a2a247","created_at":"2026-09-06T15:41:07.397Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d24831ee74020d8d2219c4259139fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-38fc5918410678aed6a2a247: start","job_status":"start","queue_duration_s":1.026231,"scheduling_latency_s":1.026254}1450gitlab # [ 255.635532] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.445Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1451gitlab # [ 255.639466] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"38fc5918410678aed6a2a247","created_at":"2026-09-06T15:41:07.397Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d24831ee74020d8d2219c4259139fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-38fc5918410678aed6a2a247: done: 0.01451 sec","job_status":"done","queue_duration_s":1.026231,"scheduling_latency_s":1.026254,"redis_calls":7,"redis_duration_s":0.001084,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01451,"completed_at":"2026-09-06T15:41:08.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 255.680102] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.452Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"8b288468d0b61eba30bd9d75","created_at":"2026-09-06T15:41:07.432Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6b10eb26b344129787190e6fad0a0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.437Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-8b288468d0b61eba30bd9d75: start","job_status":"start","queue_duration_s":1.014039,"scheduling_latency_s":1.014061}1453gitlab # [ 255.693490] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"8b288468d0b61eba30bd9d75","created_at":"2026-09-06T15:41:07.432Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6b10eb26b344129787190e6fad0a0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.437Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-8b288468d0b61eba30bd9d75: done: 0.018514 sec","job_status":"done","queue_duration_s":1.014039,"scheduling_latency_s":1.014061,"redis_calls":7,"redis_duration_s":0.001032,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018514,"completed_at":"2026-09-06T15:41:08.470Z","load_balancing_strategy":"primary","db_duration_s":0.001173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 255.732650] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"05ab4fdd3e3fcbd8f4a70f17","created_at":"2026-09-06T15:41:07.460Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d8a89bbf481718919d3e1ec32b6f636","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.468Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-05ab4fdd3e3fcbd8f4a70f17: start","job_status":"start","queue_duration_s":1.002955,"scheduling_latency_s":1.002975}1455gitlab # [ 255.875234] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"05ab4fdd3e3fcbd8f4a70f17","created_at":"2026-09-06T15:41:07.460Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d8a89bbf481718919d3e1ec32b6f636","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.468Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-05ab4fdd3e3fcbd8f4a70f17: done: 0.319853 sec","job_status":"done","queue_duration_s":1.002955,"scheduling_latency_s":1.002975,"redis_calls":562,"redis_duration_s":0.059648,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.05899,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.297054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.319853,"completed_at":"2026-09-06T15:41:08.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 255.916099] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0a19739c4c14e68af3a3dc9d","created_at":"2026-09-06T15:41:07.478Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e736d2d738f0a30dc7d881812170208","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.486Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0a19739c4c14e68af3a3dc9d: start","job_status":"start","queue_duration_s":1.306826,"scheduling_latency_s":1.306845}1457gitlab # [ 255.930829] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0a19739c4c14e68af3a3dc9d","created_at":"2026-09-06T15:41:07.478Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e736d2d738f0a30dc7d881812170208","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.486Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0a19739c4c14e68af3a3dc9d: done: 0.014398 sec","job_status":"done","queue_duration_s":1.306826,"scheduling_latency_s":1.306845,"redis_calls":7,"redis_duration_s":0.001642,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014398,"completed_at":"2026-09-06T15:41:08.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 255.972185] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c54031dfb30f574c7071b2ec","created_at":"2026-09-06T15:41:07.511Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"283a5d4864e86fdb6ebc14d2b1b73948","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.518Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c54031dfb30f574c7071b2ec: start","job_status":"start","queue_duration_s":1.290946,"scheduling_latency_s":1.290961}1459gitlab # [ 255.986747] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.817Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1460gitlab # [ 255.990420] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c54031dfb30f574c7071b2ec","created_at":"2026-09-06T15:41:07.511Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"283a5d4864e86fdb6ebc14d2b1b73948","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.518Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c54031dfb30f574c7071b2ec: done: 0.013568 sec","job_status":"done","queue_duration_s":1.290946,"scheduling_latency_s":1.290961,"redis_calls":7,"redis_duration_s":0.001617,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013568,"completed_at":"2026-09-06T15:41:08.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 256.032393] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"81e5f391efc9cdc86dc188a0","created_at":"2026-09-06T15:41:07.534Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29fcb4b1a1999f6fdb4dbefdfd6b1424","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.539Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-81e5f391efc9cdc86dc188a0: start","job_status":"start","queue_duration_s":1.284767,"scheduling_latency_s":1.284783}1462gitlab # [ 256.046992] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"81e5f391efc9cdc86dc188a0","created_at":"2026-09-06T15:41:07.534Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29fcb4b1a1999f6fdb4dbefdfd6b1424","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:41:07.539Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-81e5f391efc9cdc86dc188a0: done: 0.044492 sec","job_status":"done","queue_duration_s":1.284767,"scheduling_latency_s":1.284783,"redis_calls":9,"redis_duration_s":0.002496,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056116,"exclusive_lock_hold_duration_s":0.02858112,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.044492,"completed_at":"2026-09-06T15:41:08.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 256.090673] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f962babb4520b2ee500b3490","created_at":"2026-09-06T15:41:07.552Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"481065b9bd89c68105c80c9ea7de8915","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:41:07.555Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f962babb4520b2ee500b3490: start","job_status":"start","queue_duration_s":1.314964,"scheduling_latency_s":1.31498}1464gitlab # [ 256.104327] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.879Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1465gitlab # [ 256.107831] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f962babb4520b2ee500b3490","created_at":"2026-09-06T15:41:07.552Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"481065b9bd89c68105c80c9ea7de8915","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:41:07.555Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f962babb4520b2ee500b3490: done: 0.013758 sec","job_status":"done","queue_duration_s":1.314964,"scheduling_latency_s":1.31498,"redis_calls":7,"redis_duration_s":0.001604,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013758,"completed_at":"2026-09-06T15:41:08.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 256.147866] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5567f65cc712b4ca568598c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5567f65cc712b4ca568598c: start","job_status":"start","queue_duration_s":0.622682,"scheduling_latency_s":0.622699}1467gitlab # [ 256.160624] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5567f65cc712b4ca568598c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5567f65cc712b4ca568598c: done: 0.017179 sec","job_status":"done","queue_duration_s":0.622682,"scheduling_latency_s":0.622699,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017179,"completed_at":"2026-09-06T15:41:08.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 256.200921] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43622ec54b9ebb378d4ff172","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43622ec54b9ebb378d4ff172: start","job_status":"start","queue_duration_s":0.64122,"scheduling_latency_s":0.641235}1469gitlab # [ 256.213316] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43622ec54b9ebb378d4ff172","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43622ec54b9ebb378d4ff172: done: 0.016646 sec","job_status":"done","queue_duration_s":0.64122,"scheduling_latency_s":0.641235,"redis_calls":13,"redis_duration_s":0.00309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016646,"completed_at":"2026-09-06T15:41:08.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 256.252778] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"943ad9574c5408099a15ee9d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-943ad9574c5408099a15ee9d: start","job_status":"start","queue_duration_s":0.65915,"scheduling_latency_s":0.659166}1471gitlab # [ 256.265195] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"943ad9574c5408099a15ee9d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-943ad9574c5408099a15ee9d: done: 0.016127 sec","job_status":"done","queue_duration_s":0.65915,"scheduling_latency_s":0.659166,"redis_calls":13,"redis_duration_s":0.002598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001661,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016127,"completed_at":"2026-09-06T15:41:08.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 256.304529] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5265aa254f001c995636b518","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5265aa254f001c995636b518: start","job_status":"start","queue_duration_s":0.676595,"scheduling_latency_s":0.676611}1473gitlab # [ 256.317057] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5265aa254f001c995636b518","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5265aa254f001c995636b518: done: 0.016373 sec","job_status":"done","queue_duration_s":0.676595,"scheduling_latency_s":0.676611,"redis_calls":13,"redis_duration_s":0.0027270000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016373,"completed_at":"2026-09-06T15:41:08.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 256.356862] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e09d34a1fe02e5547fc840c6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e09d34a1fe02e5547fc840c6: start","job_status":"start","queue_duration_s":0.695298,"scheduling_latency_s":0.695315}1475gitlab # [ 256.369172] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e09d34a1fe02e5547fc840c6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e09d34a1fe02e5547fc840c6: done: 0.016438 sec","job_status":"done","queue_duration_s":0.695298,"scheduling_latency_s":0.695315,"redis_calls":13,"redis_duration_s":0.002996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016438,"completed_at":"2026-09-06T15:41:08.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 256.409372] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a186b58a58ea6615d52d5cc","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a186b58a58ea6615d52d5cc: start","job_status":"start","queue_duration_s":0.713083,"scheduling_latency_s":0.713099}1477gitlab # [ 256.421951] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a186b58a58ea6615d52d5cc","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a186b58a58ea6615d52d5cc: done: 0.016034 sec","job_status":"done","queue_duration_s":0.713083,"scheduling_latency_s":0.713099,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016034,"completed_at":"2026-09-06T15:41:08.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 256.461279] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:08.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448252f3fed8300770467293","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448252f3fed8300770467293: start","job_status":"start","queue_duration_s":0.730506,"scheduling_latency_s":0.730521}1479gitlab # [ 256.473708] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"448252f3fed8300770467293","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-448252f3fed8300770467293: done: 0.016194 sec","job_status":"done","queue_duration_s":0.730506,"scheduling_latency_s":0.730521,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016194,"completed_at":"2026-09-06T15:41:09.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 256.513192] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f676986838f82e05d56da28","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f676986838f82e05d56da28: start","job_status":"start","queue_duration_s":0.748049,"scheduling_latency_s":0.748063}1481gitlab # [ 256.525882] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f676986838f82e05d56da28","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f676986838f82e05d56da28: done: 0.015811 sec","job_status":"done","queue_duration_s":0.748049,"scheduling_latency_s":0.748063,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015811,"completed_at":"2026-09-06T15:41:09.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 256.565513] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a4c13ec89a9d5a8a2c4aa6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a4c13ec89a9d5a8a2c4aa6: start","job_status":"start","queue_duration_s":0.766093,"scheduling_latency_s":0.76611}1483gitlab # [ 256.577962] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a4c13ec89a9d5a8a2c4aa6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a4c13ec89a9d5a8a2c4aa6: done: 0.016148 sec","job_status":"done","queue_duration_s":0.766093,"scheduling_latency_s":0.76611,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016148,"completed_at":"2026-09-06T15:41:09.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 256.618010] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b997cac84d8236fdd9ca1622","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b997cac84d8236fdd9ca1622: start","job_status":"start","queue_duration_s":0.783542,"scheduling_latency_s":0.783557}1485gitlab # [ 256.630567] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b997cac84d8236fdd9ca1622","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b997cac84d8236fdd9ca1622: done: 0.016036 sec","job_status":"done","queue_duration_s":0.783542,"scheduling_latency_s":0.783557,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016036,"completed_at":"2026-09-06T15:41:09.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 256.670396] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"503891bc7c72e25c53ba4e40","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-503891bc7c72e25c53ba4e40: start","job_status":"start","queue_duration_s":0.800911,"scheduling_latency_s":0.800925}1487gitlab # [ 256.682746] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"503891bc7c72e25c53ba4e40","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-503891bc7c72e25c53ba4e40: done: 0.016257 sec","job_status":"done","queue_duration_s":0.800911,"scheduling_latency_s":0.800925,"redis_calls":13,"redis_duration_s":0.003074,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016257,"completed_at":"2026-09-06T15:41:09.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 256.720828] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c147604e8368188996f91d7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c147604e8368188996f91d7: start","job_status":"start","queue_duration_s":0.818556,"scheduling_latency_s":0.818572}1489gitlab # [ 256.733044] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c147604e8368188996f91d7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c147604e8368188996f91d7: done: 0.015988 sec","job_status":"done","queue_duration_s":0.818556,"scheduling_latency_s":0.818572,"redis_calls":13,"redis_duration_s":0.002762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015988,"completed_at":"2026-09-06T15:41:09.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 256.771466] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f569aee6685e06275a6675","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f569aee6685e06275a6675: start","job_status":"start","queue_duration_s":0.836815,"scheduling_latency_s":0.83683}1491gitlab # [ 256.783701] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f569aee6685e06275a6675","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f569aee6685e06275a6675: done: 0.016328 sec","job_status":"done","queue_duration_s":0.836815,"scheduling_latency_s":0.83683,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016328,"completed_at":"2026-09-06T15:41:09.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 256.823164] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc886c48c7154d62ee80409e","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc886c48c7154d62ee80409e: start","job_status":"start","queue_duration_s":0.854588,"scheduling_latency_s":0.854604}1493gitlab # [ 256.835537] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc886c48c7154d62ee80409e","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc886c48c7154d62ee80409e: done: 0.033382 sec","job_status":"done","queue_duration_s":0.854588,"scheduling_latency_s":0.854604,"redis_calls":13,"redis_duration_s":0.011373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002624,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033382,"completed_at":"2026-09-06T15:41:09.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 256.874163] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b65aadf290696b309a369fc","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b65aadf290696b309a369fc: start","job_status":"start","queue_duration_s":0.890916,"scheduling_latency_s":0.890958}1495gitlab # [ 256.886232] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b65aadf290696b309a369fc","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b65aadf290696b309a369fc: done: 0.062315 sec","job_status":"done","queue_duration_s":0.890916,"scheduling_latency_s":0.890958,"redis_calls":13,"redis_duration_s":0.019333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005319,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062315,"completed_at":"2026-09-06T15:41:09.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 256.924590] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"165a13b28d25edc5e5b0de0a","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-165a13b28d25edc5e5b0de0a: start","job_status":"start","queue_duration_s":0.960117,"scheduling_latency_s":0.960178}1497gitlab # [ 256.936742] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"165a13b28d25edc5e5b0de0a","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-165a13b28d25edc5e5b0de0a: done: 0.05044 sec","job_status":"done","queue_duration_s":0.960117,"scheduling_latency_s":0.960178,"redis_calls":13,"redis_duration_s":0.003881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05044,"completed_at":"2026-09-06T15:41:09.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 256.974889] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7646c72341c61afa123ec92b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7646c72341c61afa123ec92b: start","job_status":"start","queue_duration_s":1.010592,"scheduling_latency_s":1.010619}1499gitlab # [ 256.987350] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7646c72341c61afa123ec92b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7646c72341c61afa123ec92b: done: 0.024057 sec","job_status":"done","queue_duration_s":1.010592,"scheduling_latency_s":1.010619,"redis_calls":13,"redis_duration_s":0.002622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024057,"completed_at":"2026-09-06T15:41:09.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 257.026802] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"809d928ecf2d25d6470b1541","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-809d928ecf2d25d6470b1541: start","job_status":"start","queue_duration_s":1.036197,"scheduling_latency_s":1.036219}1501gitlab # [ 257.039372] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"809d928ecf2d25d6470b1541","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-809d928ecf2d25d6470b1541: done: 0.019854 sec","job_status":"done","queue_duration_s":1.036197,"scheduling_latency_s":1.036219,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001806,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019854,"completed_at":"2026-09-06T15:41:09.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 257.077774] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6d0b02e3f5d3abd7c4d39f","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6d0b02e3f5d3abd7c4d39f: start","job_status":"start","queue_duration_s":1.057601,"scheduling_latency_s":1.057619}1503gitlab # [ 257.090027] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6d0b02e3f5d3abd7c4d39f","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6d0b02e3f5d3abd7c4d39f: done: 0.017469 sec","job_status":"done","queue_duration_s":1.057601,"scheduling_latency_s":1.057619,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017469,"completed_at":"2026-09-06T15:41:09.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 257.128316] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18eb587533487e399c86ebe1","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18eb587533487e399c86ebe1: start","job_status":"start","queue_duration_s":1.077772,"scheduling_latency_s":1.077789}1505gitlab # [ 257.140395] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18eb587533487e399c86ebe1","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18eb587533487e399c86ebe1: done: 0.016766 sec","job_status":"done","queue_duration_s":1.077772,"scheduling_latency_s":1.077789,"redis_calls":13,"redis_duration_s":0.0026820000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016766,"completed_at":"2026-09-06T15:41:09.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 257.178629] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07cf8a988dcb6ddad20ecfb","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07cf8a988dcb6ddad20ecfb: start","job_status":"start","queue_duration_s":1.095997,"scheduling_latency_s":1.096013}1507gitlab # [ 257.190962] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07cf8a988dcb6ddad20ecfb","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07cf8a988dcb6ddad20ecfb: done: 0.017249 sec","job_status":"done","queue_duration_s":1.095997,"scheduling_latency_s":1.096013,"redis_calls":13,"redis_duration_s":0.0032170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017249,"completed_at":"2026-09-06T15:41:09.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 257.230264] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e2256c277cc40f5aba7da55","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e2256c277cc40f5aba7da55: start","job_status":"start","queue_duration_s":1.114761,"scheduling_latency_s":1.114778}1509gitlab # [ 257.242344] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e2256c277cc40f5aba7da55","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e2256c277cc40f5aba7da55: done: 0.017686 sec","job_status":"done","queue_duration_s":1.114761,"scheduling_latency_s":1.114778,"redis_calls":13,"redis_duration_s":0.002934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017686,"completed_at":"2026-09-06T15:41:09.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 257.280649] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60efb09c239967fa88b4c90d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60efb09c239967fa88b4c90d: start","job_status":"start","queue_duration_s":1.13388,"scheduling_latency_s":1.133897}1511gitlab # [ 257.292739] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60efb09c239967fa88b4c90d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60efb09c239967fa88b4c90d: done: 0.016077 sec","job_status":"done","queue_duration_s":1.13388,"scheduling_latency_s":1.133897,"redis_calls":13,"redis_duration_s":0.002622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016077,"completed_at":"2026-09-06T15:41:09.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 257.330656] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f439a8b2c3d0e85691bc1172","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f439a8b2c3d0e85691bc1172: start","job_status":"start","queue_duration_s":1.152489,"scheduling_latency_s":1.152505}1513gitlab # [ 257.342851] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f439a8b2c3d0e85691bc1172","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f439a8b2c3d0e85691bc1172: done: 0.016571 sec","job_status":"done","queue_duration_s":1.152489,"scheduling_latency_s":1.152505,"redis_calls":13,"redis_duration_s":0.002866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016571,"completed_at":"2026-09-06T15:41:09.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 257.381067] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9167048e9b122db30965fa","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9167048e9b122db30965fa: start","job_status":"start","queue_duration_s":1.170528,"scheduling_latency_s":1.170545}1515gitlab # [ 257.392946] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9167048e9b122db30965fa","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9167048e9b122db30965fa: done: 0.017166 sec","job_status":"done","queue_duration_s":1.170528,"scheduling_latency_s":1.170545,"redis_calls":13,"redis_duration_s":0.003294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017166,"completed_at":"2026-09-06T15:41:09.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 257.432911] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cce8bd2e158b58a6f2792e8","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cce8bd2e158b58a6f2792e8: start","job_status":"start","queue_duration_s":1.189131,"scheduling_latency_s":1.189147}1517gitlab # [ 257.445228] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cce8bd2e158b58a6f2792e8","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cce8bd2e158b58a6f2792e8: done: 0.016839 sec","job_status":"done","queue_duration_s":1.189131,"scheduling_latency_s":1.189147,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016839,"completed_at":"2026-09-06T15:41:09.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 257.484002] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90cd3326ba2772ef36b204e","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90cd3326ba2772ef36b204e: start","job_status":"start","queue_duration_s":1.207469,"scheduling_latency_s":1.207485}1519gitlab # [ 257.496088] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90cd3326ba2772ef36b204e","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90cd3326ba2772ef36b204e: done: 0.026409 sec","job_status":"done","queue_duration_s":1.207469,"scheduling_latency_s":1.207485,"redis_calls":13,"redis_duration_s":0.008952,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00287,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026409,"completed_at":"2026-09-06T15:41:09.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 257.534109] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"790aa51f4fe8bd932bf6e99b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-790aa51f4fe8bd932bf6e99b: start","job_status":"start","queue_duration_s":1.238993,"scheduling_latency_s":1.239011}1521gitlab # [ 257.546062] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"790aa51f4fe8bd932bf6e99b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-790aa51f4fe8bd932bf6e99b: done: 0.019829 sec","job_status":"done","queue_duration_s":1.238993,"scheduling_latency_s":1.239011,"redis_calls":13,"redis_duration_s":0.004972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019829,"completed_at":"2026-09-06T15:41:09.521Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 257.584050] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ac352c3a3f8befa9464b84","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ac352c3a3f8befa9464b84: start","job_status":"start","queue_duration_s":1.260064,"scheduling_latency_s":1.260081}1523gitlab # [ 257.596061] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ac352c3a3f8befa9464b84","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ac352c3a3f8befa9464b84: done: 0.015914 sec","job_status":"done","queue_duration_s":1.260064,"scheduling_latency_s":1.260081,"redis_calls":13,"redis_duration_s":0.001628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015914,"completed_at":"2026-09-06T15:41:09.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 257.634717] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac41badec0013163146182c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac41badec0013163146182c: start","job_status":"start","queue_duration_s":1.277077,"scheduling_latency_s":1.277094}1525gitlab # [ 257.647008] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac41badec0013163146182c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac41badec0013163146182c: done: 0.015453 sec","job_status":"done","queue_duration_s":1.277077,"scheduling_latency_s":1.277094,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-09-06T15:41:09.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 257.685696] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7de5d9c3995ce650a398b486","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7de5d9c3995ce650a398b486: start","job_status":"start","queue_duration_s":1.29445,"scheduling_latency_s":1.294468}1527gitlab # [ 257.697834] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7de5d9c3995ce650a398b486","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7de5d9c3995ce650a398b486: done: 0.01504 sec","job_status":"done","queue_duration_s":1.29445,"scheduling_latency_s":1.294468,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01504,"completed_at":"2026-09-06T15:41:09.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 257.736107] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a945d2ac863ccb8843c34f9","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a945d2ac863ccb8843c34f9: start","job_status":"start","queue_duration_s":1.310591,"scheduling_latency_s":1.310608}1529gitlab # [ 257.748028] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a945d2ac863ccb8843c34f9","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a945d2ac863ccb8843c34f9: done: 0.016212 sec","job_status":"done","queue_duration_s":1.310591,"scheduling_latency_s":1.310608,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016212,"completed_at":"2026-09-06T15:41:09.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 257.785718] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe16ddec04d0ea477215e7b0","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe16ddec04d0ea477215e7b0: start","job_status":"start","queue_duration_s":1.327894,"scheduling_latency_s":1.32791}1531gitlab # [ 257.797641] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe16ddec04d0ea477215e7b0","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe16ddec04d0ea477215e7b0: done: 0.013992 sec","job_status":"done","queue_duration_s":1.327894,"scheduling_latency_s":1.32791,"redis_calls":13,"redis_duration_s":0.001376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013992,"completed_at":"2026-09-06T15:41:09.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 257.836634] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf486060e8ed76359d18a72","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf486060e8ed76359d18a72: start","job_status":"start","queue_duration_s":1.342954,"scheduling_latency_s":1.34297}1533gitlab # [ 257.848626] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf486060e8ed76359d18a72","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf486060e8ed76359d18a72: done: 0.016307 sec","job_status":"done","queue_duration_s":1.342954,"scheduling_latency_s":1.34297,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016307,"completed_at":"2026-09-06T15:41:09.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 257.886309] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be04dcddedd26a6eba2f88d7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be04dcddedd26a6eba2f88d7: start","job_status":"start","queue_duration_s":1.360336,"scheduling_latency_s":1.360351}1535gitlab # [ 257.898388] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be04dcddedd26a6eba2f88d7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be04dcddedd26a6eba2f88d7: done: 0.014952 sec","job_status":"done","queue_duration_s":1.360336,"scheduling_latency_s":1.360351,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014952,"completed_at":"2026-09-06T15:41:09.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 257.936139] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbfb760d735461f167b7b640","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbfb760d735461f167b7b640: start","job_status":"start","queue_duration_s":1.376405,"scheduling_latency_s":1.376422}1537gitlab # [ 257.948123] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbfb760d735461f167b7b640","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbfb760d735461f167b7b640: done: 0.015128 sec","job_status":"done","queue_duration_s":1.376405,"scheduling_latency_s":1.376422,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015128,"completed_at":"2026-09-06T15:41:09.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 257.986173] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db8e8aba41a868a7f0c8a03","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db8e8aba41a868a7f0c8a03: start","job_status":"start","queue_duration_s":1.392562,"scheduling_latency_s":1.392578}1539gitlab # [ 257.998369] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db8e8aba41a868a7f0c8a03","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db8e8aba41a868a7f0c8a03: done: 0.014522 sec","job_status":"done","queue_duration_s":1.392562,"scheduling_latency_s":1.392578,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014522,"completed_at":"2026-09-06T15:41:09.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 258.037572] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66fc19e955a58e66502e23c4","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66fc19e955a58e66502e23c4: start","job_status":"start","queue_duration_s":1.408756,"scheduling_latency_s":1.408773}1541gitlab # [ 258.049833] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66fc19e955a58e66502e23c4","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66fc19e955a58e66502e23c4: done: 0.015147 sec","job_status":"done","queue_duration_s":1.408756,"scheduling_latency_s":1.408773,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015147,"completed_at":"2026-09-06T15:41:09.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 258.088248] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8b065ebb3845b641b8f818","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8b065ebb3845b641b8f818: start","job_status":"start","queue_duration_s":1.424961,"scheduling_latency_s":1.424977}1543gitlab # [ 258.100353] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8b065ebb3845b641b8f818","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8b065ebb3845b641b8f818: done: 0.014673 sec","job_status":"done","queue_duration_s":1.424961,"scheduling_latency_s":1.424977,"redis_calls":13,"redis_duration_s":0.002002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014673,"completed_at":"2026-09-06T15:41:09.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 258.138752] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbe51b14853a165736b5cf0","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbe51b14853a165736b5cf0: start","job_status":"start","queue_duration_s":1.440657,"scheduling_latency_s":1.440673}1545gitlab # [ 258.151068] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbe51b14853a165736b5cf0","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbe51b14853a165736b5cf0: done: 0.014605 sec","job_status":"done","queue_duration_s":1.440657,"scheduling_latency_s":1.440673,"redis_calls":13,"redis_duration_s":0.00138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014605,"completed_at":"2026-09-06T15:41:09.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 258.189825] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b45c3a30fb03218113b3f64d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b45c3a30fb03218113b3f64d: start","job_status":"start","queue_duration_s":1.456333,"scheduling_latency_s":1.45635}1547gitlab # [ 258.202017] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b45c3a30fb03218113b3f64d","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b45c3a30fb03218113b3f64d: done: 0.014869 sec","job_status":"done","queue_duration_s":1.456333,"scheduling_latency_s":1.45635,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014869,"completed_at":"2026-09-06T15:41:09.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 258.241021] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3657184e48dde57ede659cdd","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3657184e48dde57ede659cdd: start","job_status":"start","queue_duration_s":1.472987,"scheduling_latency_s":1.473004}1549gitlab # [ 258.253183] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3657184e48dde57ede659cdd","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3657184e48dde57ede659cdd: done: 0.01491 sec","job_status":"done","queue_duration_s":1.472987,"scheduling_latency_s":1.473004,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01491,"completed_at":"2026-09-06T15:41:09.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 258.291668] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca5a686a5c18658c4969f05b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca5a686a5c18658c4969f05b: start","job_status":"start","queue_duration_s":1.488946,"scheduling_latency_s":1.488962}1551gitlab # [ 258.304068] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca5a686a5c18658c4969f05b","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca5a686a5c18658c4969f05b: done: 0.014778 sec","job_status":"done","queue_duration_s":1.488946,"scheduling_latency_s":1.488962,"redis_calls":13,"redis_duration_s":0.0013939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014778,"completed_at":"2026-09-06T15:41:09.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 258.342270] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48b8088db79748ef5f3170a7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48b8088db79748ef5f3170a7: start","job_status":"start","queue_duration_s":1.504758,"scheduling_latency_s":1.504774}1553gitlab # [ 258.354519] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48b8088db79748ef5f3170a7","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48b8088db79748ef5f3170a7: done: 0.015318 sec","job_status":"done","queue_duration_s":1.504758,"scheduling_latency_s":1.504774,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015318,"completed_at":"2026-09-06T15:41:09.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 258.392805] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c9af3952a774cd3ac2cd77c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c9af3952a774cd3ac2cd77c: start","job_status":"start","queue_duration_s":1.521103,"scheduling_latency_s":1.52112}1555gitlab # [ 258.404853] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c9af3952a774cd3ac2cd77c","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c9af3952a774cd3ac2cd77c: done: 0.01535 sec","job_status":"done","queue_duration_s":1.521103,"scheduling_latency_s":1.52112,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01535,"completed_at":"2026-09-06T15:41:09.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 258.444230] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"420a86ae097d411618b132a8","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-420a86ae097d411618b132a8: start","job_status":"start","queue_duration_s":1.537514,"scheduling_latency_s":1.53753}1557gitlab # [ 258.456391] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"420a86ae097d411618b132a8","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-420a86ae097d411618b132a8: done: 0.015001 sec","job_status":"done","queue_duration_s":1.537514,"scheduling_latency_s":1.53753,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-09-06T15:41:09.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 258.494587] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feb81c773bc76684d328fa6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feb81c773bc76684d328fa6: start","job_status":"start","queue_duration_s":1.553621,"scheduling_latency_s":1.553638}1559gitlab # [ 258.506906] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feb81c773bc76684d328fa6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feb81c773bc76684d328fa6: done: 0.014332 sec","job_status":"done","queue_duration_s":1.553621,"scheduling_latency_s":1.553638,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014332,"completed_at":"2026-09-06T15:41:09.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 258.545481] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c315676d3cd25b02769061db","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c315676d3cd25b02769061db: start","job_status":"start","queue_duration_s":1.56899,"scheduling_latency_s":1.569007}1561gitlab # [ 258.557391] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c315676d3cd25b02769061db","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c315676d3cd25b02769061db: done: 0.014209 sec","job_status":"done","queue_duration_s":1.56899,"scheduling_latency_s":1.569007,"redis_calls":13,"redis_duration_s":0.00136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014209,"completed_at":"2026-09-06T15:41:09.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 258.595741] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b10fdd3fa2fd96ae9f1706c6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b10fdd3fa2fd96ae9f1706c6: start","job_status":"start","queue_duration_s":1.584546,"scheduling_latency_s":1.584563}1563gitlab # [ 258.608064] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b10fdd3fa2fd96ae9f1706c6","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b10fdd3fa2fd96ae9f1706c6: done: 0.014525 sec","job_status":"done","queue_duration_s":1.584546,"scheduling_latency_s":1.584563,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014525,"completed_at":"2026-09-06T15:41:09.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 258.646840] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869132e20d1541630cf58324","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869132e20d1541630cf58324: start","job_status":"start","queue_duration_s":1.600111,"scheduling_latency_s":1.600127}1565gitlab # [ 258.659078] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869132e20d1541630cf58324","created_at":"2026-09-06T15:41:08.185Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-5b8f251589404c0d","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f0e3371aa9d9946beb43171dff9b0e82","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869132e20d1541630cf58324: done: 0.01451 sec","job_status":"done","queue_duration_s":1.600111,"scheduling_latency_s":1.600127,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-09-06T15:41:09.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 258.697594] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.878Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"515f4adf399a6c72ce3f8d17","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-515f4adf399a6c72ce3f8d17: start","job_status":"start","queue_duration_s":1.469128,"scheduling_latency_s":1.469146}1567gitlab # [ 258.709845] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.891Z","message":"No existing merge request to be cleaned up."}1568gitlab # [ 258.711509] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.899Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"515f4adf399a6c72ce3f8d17","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-515f4adf399a6c72ce3f8d17: done: 0.021082 sec","job_status":"done","queue_duration_s":1.469128,"scheduling_latency_s":1.469146,"redis_calls":10,"redis_duration_s":0.0013340000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021082,"completed_at":"2026-09-06T15:41:09.899Z","load_balancing_strategy":"primary","db_duration_s":0.003316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 258.749507] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.901Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c71bd27b0575a2f814851b9","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c71bd27b0575a2f814851b9: start","job_status":"start","queue_duration_s":1.49162,"scheduling_latency_s":1.491637}1570gitlab # [ 258.761551] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.912Z","message":"No existing merge request to be cleaned up."}1571gitlab # [ 258.763186] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c71bd27b0575a2f814851b9","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c71bd27b0575a2f814851b9: done: 0.019083 sec","job_status":"done","queue_duration_s":1.49162,"scheduling_latency_s":1.491637,"redis_calls":10,"redis_duration_s":0.001271,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019083,"completed_at":"2026-09-06T15:41:09.920Z","load_balancing_strategy":"primary","db_duration_s":0.002583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 258.800560] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.921Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5d36023858b15d1ab1cd1efe","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5d36023858b15d1ab1cd1efe: start","job_status":"start","queue_duration_s":1.511773,"scheduling_latency_s":1.51179}1573gitlab # [ 258.812495] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.932Z","message":"No existing merge request to be cleaned up."}1574gitlab # [ 258.814116] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.940Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5d36023858b15d1ab1cd1efe","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5d36023858b15d1ab1cd1efe: done: 0.019063 sec","job_status":"done","queue_duration_s":1.511773,"scheduling_latency_s":1.51179,"redis_calls":10,"redis_duration_s":0.001278,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019063,"completed_at":"2026-09-06T15:41:09.940Z","load_balancing_strategy":"primary","db_duration_s":0.002722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 258.852972] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.941Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a51951efbd1a12a091093459","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a51951efbd1a12a091093459: start","job_status":"start","queue_duration_s":1.532201,"scheduling_latency_s":1.532217}1576gitlab # [ 258.865073] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.952Z","message":"No existing merge request to be cleaned up."}1577gitlab # [ 258.866732] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:41:09.960Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a51951efbd1a12a091093459","created_at":"2026-09-06T15:41:08.307Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-89fb4062bbda4e80","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"298d4f1755577b5a7eda9adefea8b0e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:41:08.409Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a51951efbd1a12a091093459: done: 0.019004 sec","job_status":"done","queue_duration_s":1.532201,"scheduling_latency_s":1.532217,"redis_calls":10,"redis_duration_s":0.001263,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019004,"completed_at":"2026-09-06T15:41:09.960Z","load_balancing_strategy":"primary","db_duration_s":0.00282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 273.198560] setup-gitlab-start[2967]: W, [2026-09-06T15:41:26.114669 #2967] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1579gitlab # [ 309.120208] redis[795]: 10 changes in 300 seconds. Saving...1580gitlab # [ 309.127007] redis[795]: Background saving started by pid 33001581gitlab # [ 309.131673] redis[3300]: BGSAVE done, 493 keys saved, 0 keys skipped, 125930 bytes written.1582gitlab # [ 309.136233] redis[3300]: DB saved on disk1583gitlab # [ 309.138406] redis[3300]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1584gitlab # [ 309.221316] redis[795]: Background saving terminated with success1585gitlab # [ 309.540519] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.454Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3ca04fed4b7196932f4528dc","created_at":"2026-09-06T15:42:02.382Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d445c2706e12aea592c53a9ff0860d73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.450Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3ca04fed4b7196932f4528dc: start","job_status":"start","queue_duration_s":0.003872,"scheduling_latency_s":0.00393}1586gitlab # [ 309.758458] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3ca04fed4b7196932f4528dc","created_at":"2026-09-06T15:42:02.382Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d445c2706e12aea592c53a9ff0860d73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.450Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3ca04fed4b7196932f4528dc: done: 0.219882 sec","job_status":"done","queue_duration_s":0.003872,"scheduling_latency_s":0.00393,"redis_calls":17,"redis_duration_s":0.057866,"redis_read_bytes":1031,"redis_write_bytes":1616,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.017364,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":544,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.02272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.017782,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00537612,"exclusive_lock_hold_duration_s":0.01649282,"duration_s":0.219882,"completed_at":"2026-09-06T15:42:02.673Z","load_balancing_strategy":"primary","db_duration_s":0.005703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 309.836665] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ff1c600747d4678077462f15","created_at":"2026-09-06T15:42:02.463Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ca3232dacda26f612e79b5e1655c7f1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.470Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ff1c600747d4678077462f15: start","job_status":"start","queue_duration_s":0.218924,"scheduling_latency_s":0.218979}1588gitlab # [ 309.909747] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ff1c600747d4678077462f15","created_at":"2026-09-06T15:42:02.463Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ca3232dacda26f612e79b5e1655c7f1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.470Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ff1c600747d4678077462f15: done: 0.134262 sec","job_status":"done","queue_duration_s":0.218924,"scheduling_latency_s":0.218979,"redis_calls":11,"redis_duration_s":0.019707,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003989,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009914,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.134262,"completed_at":"2026-09-06T15:42:02.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 309.980643] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fcd7e8ba0f57b230dca66f04","created_at":"2026-09-06T15:42:02.480Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"276794a904f00e5533212a6a5ca442ee","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.487Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fcd7e8ba0f57b230dca66f04: start","job_status":"start","queue_duration_s":0.35522,"scheduling_latency_s":0.355279}1590gitlab # [ 310.004404] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"fcd7e8ba0f57b230dca66f04","created_at":"2026-09-06T15:42:02.480Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"276794a904f00e5533212a6a5ca442ee","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.487Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-fcd7e8ba0f57b230dca66f04: done: 0.077265 sec","job_status":"done","queue_duration_s":0.35522,"scheduling_latency_s":0.355279,"redis_calls":11,"redis_duration_s":0.004333999999999999,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000978,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000358,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077265,"completed_at":"2026-09-06T15:42:02.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 310.059625] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:02.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2c74ef1edc0c756b8fc1415a","created_at":"2026-09-06T15:42:02.500Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b883ce907883c8044a8db5ceb75f94d9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.507Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2c74ef1edc0c756b8fc1415a: start","job_status":"start","queue_duration_s":0.422844,"scheduling_latency_s":0.422906}1592gitlab # [ 310.112267] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2c74ef1edc0c756b8fc1415a","created_at":"2026-09-06T15:42:02.500Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b883ce907883c8044a8db5ceb75f94d9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.507Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2c74ef1edc0c756b8fc1415a: done: 0.097231 sec","job_status":"done","queue_duration_s":0.422844,"scheduling_latency_s":0.422906,"redis_calls":10,"redis_duration_s":0.020823,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00037,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139758,"exclusive_lock_hold_duration_s":0.0150681,"duration_s":0.097231,"completed_at":"2026-09-06T15:42:03.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 310.194444] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"06044f6985926bee5f28670e","created_at":"2026-09-06T15:42:02.520Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9f9e8c587ba5d928cd4d83bae731aea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.526Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-06044f6985926bee5f28670e: start","job_status":"start","queue_duration_s":0.530883,"scheduling_latency_s":0.530942}1594gitlab # [ 310.211039] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.124Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1595gitlab # [ 310.231402] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"06044f6985926bee5f28670e","created_at":"2026-09-06T15:42:02.520Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9f9e8c587ba5d928cd4d83bae731aea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.526Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-06044f6985926bee5f28670e: done: 0.090797 sec","job_status":"done","queue_duration_s":0.530883,"scheduling_latency_s":0.530942,"redis_calls":8,"redis_duration_s":0.00744,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090797,"completed_at":"2026-09-06T15:42:03.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 310.295059] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fe19f5814c271db1efc85f46","created_at":"2026-09-06T15:42:02.541Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0770412bb71acec1031fa3befc62428","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.559Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fe19f5814c271db1efc85f46: start","job_status":"start","queue_duration_s":0.59035,"scheduling_latency_s":0.59038}1597gitlab # [ 310.352103] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fe19f5814c271db1efc85f46","created_at":"2026-09-06T15:42:02.541Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0770412bb71acec1031fa3befc62428","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.559Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fe19f5814c271db1efc85f46: done: 0.117003 sec","job_status":"done","queue_duration_s":0.59035,"scheduling_latency_s":0.59038,"redis_calls":10,"redis_duration_s":0.006611,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00019,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008189,"exclusive_lock_hold_duration_s":0.03052978,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.117003,"completed_at":"2026-09-06T15:42:03.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 310.398849] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2c50eca46d459d9d49252230","created_at":"2026-09-06T15:42:02.598Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f251945de3b24b0b865079bf5109ea27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:42:02.618Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2c50eca46d459d9d49252230: start","job_status":"start","queue_duration_s":0.684974,"scheduling_latency_s":0.685029}1599gitlab # [ 310.426066] postgres[862]: [862] LOG: checkpoint starting: time1600gitlab # [ 310.437210] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.353Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1601gitlab # [ 310.463930] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2c50eca46d459d9d49252230","created_at":"2026-09-06T15:42:02.598Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f251945de3b24b0b865079bf5109ea27","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:42:02.618Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2c50eca46d459d9d49252230: done: 0.074207 sec","job_status":"done","queue_duration_s":0.684974,"scheduling_latency_s":0.685029,"redis_calls":8,"redis_duration_s":0.027018,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.015063,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074207,"completed_at":"2026-09-06T15:42:03.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 310.514199] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"563b537bfc6771bc4fcdada0","created_at":"2026-09-06T15:42:02.647Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2409a687685a52872a5a037561b26931","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.663Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-563b537bfc6771bc4fcdada0: start","job_status":"start","queue_duration_s":0.722585,"scheduling_latency_s":0.722623}1603gitlab # [ 310.528138] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"563b537bfc6771bc4fcdada0","created_at":"2026-09-06T15:42:02.647Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2409a687685a52872a5a037561b26931","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.663Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-563b537bfc6771bc4fcdada0: done: 0.05334 sec","job_status":"done","queue_duration_s":0.722585,"scheduling_latency_s":0.722623,"redis_calls":8,"redis_duration_s":0.001801,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.0002,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.05334,"completed_at":"2026-09-06T15:42:03.439Z","load_balancing_strategy":"primary","db_duration_s":0.025907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 310.570093] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f72a83cb98e2b0136e7f815e","created_at":"2026-09-06T15:42:02.691Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecbb172d997dcaaef76384ba4a0199a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.701Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f72a83cb98e2b0136e7f815e: start","job_status":"start","queue_duration_s":0.739926,"scheduling_latency_s":0.739951}1605gitlab # [ 310.584630] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f72a83cb98e2b0136e7f815e","created_at":"2026-09-06T15:42:02.691Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecbb172d997dcaaef76384ba4a0199a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.701Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f72a83cb98e2b0136e7f815e: done: 0.017623 sec","job_status":"done","queue_duration_s":0.739926,"scheduling_latency_s":0.739951,"redis_calls":10,"redis_duration_s":0.00161,"redis_read_bytes":389,"redis_write_bytes":1078,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017623,"completed_at":"2026-09-06T15:42:03.458Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 310.626161] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c955accb3a500fee7a98b336","created_at":"2026-09-06T15:42:02.740Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cef2da073b6740c45e6a6d98374aad4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.748Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c955accb3a500fee7a98b336: start","job_status":"start","queue_duration_s":0.711296,"scheduling_latency_s":0.711319}1607gitlab # [ 310.640592] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c955accb3a500fee7a98b336","created_at":"2026-09-06T15:42:02.740Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cef2da073b6740c45e6a6d98374aad4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.748Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c955accb3a500fee7a98b336: done: 0.057612 sec","job_status":"done","queue_duration_s":0.711296,"scheduling_latency_s":0.711319,"redis_calls":10,"redis_duration_s":0.0025410000000000003,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000117,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0013334,"exclusive_lock_hold_duration_s":0.02586366,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057612,"completed_at":"2026-09-06T15:42:03.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 310.684812] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f659d5674db3d48d44e78599","created_at":"2026-09-06T15:42:02.762Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c10473d8620e717e929f9843e22f117","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.782Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f659d5674db3d48d44e78599: start","job_status":"start","queue_duration_s":0.738327,"scheduling_latency_s":0.738367}1609gitlab # [ 310.858415] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f659d5674db3d48d44e78599","created_at":"2026-09-06T15:42:02.762Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c10473d8620e717e929f9843e22f117","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.782Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f659d5674db3d48d44e78599: done: 0.253661 sec","job_status":"done","queue_duration_s":0.738327,"scheduling_latency_s":0.738367,"redis_calls":12,"redis_duration_s":0.008824,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002584,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00569,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098446,"exclusive_lock_hold_duration_s":0.21431358,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.253661,"completed_at":"2026-09-06T15:42:03.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025683,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1610gitlab # [ 310.950030] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8684731450eae48ebec64398","created_at":"2026-09-06T15:42:02.806Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"391a118ca8dc8d5c060ffd0a9e9467e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.820Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8684731450eae48ebec64398: start","job_status":"start","queue_duration_s":0.956543,"scheduling_latency_s":0.956569}1611gitlab # [ 310.969508] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8684731450eae48ebec64398","created_at":"2026-09-06T15:42:02.806Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"391a118ca8dc8d5c060ffd0a9e9467e7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.820Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8684731450eae48ebec64398: done: 0.031279 sec","job_status":"done","queue_duration_s":0.956543,"scheduling_latency_s":0.956569,"redis_calls":11,"redis_duration_s":0.0033680000000000003,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001832,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00127,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00856558,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.031279,"completed_at":"2026-09-06T15:42:03.808Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005553,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1612gitlab # [ 311.022105] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:03.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"efcb5dc78808d662ce58ee21","created_at":"2026-09-06T15:42:02.844Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd66cb5935a83da92c63efa853aaf94d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.856Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-efcb5dc78808d662ce58ee21: start","job_status":"start","queue_duration_s":0.953067,"scheduling_latency_s":0.953091}1613gitlab # [ 311.306976] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"efcb5dc78808d662ce58ee21","created_at":"2026-09-06T15:42:02.844Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd66cb5935a83da92c63efa853aaf94d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.856Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-efcb5dc78808d662ce58ee21: done: 0.412823 sec","job_status":"done","queue_duration_s":0.953067,"scheduling_latency_s":0.953091,"redis_calls":11,"redis_duration_s":0.003886,"redis_read_bytes":263,"redis_write_bytes":1140,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":153,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.345483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062946,"exclusive_lock_hold_duration_s":0.3861385,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.412823,"completed_at":"2026-09-06T15:42:04.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 311.412555] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e877c53481f7a2f9684cf456","created_at":"2026-09-06T15:42:02.906Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45098b87d414bc419a77c04e71cff7f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.923Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e877c53481f7a2f9684cf456: start","job_status":"start","queue_duration_s":1.301838,"scheduling_latency_s":1.301878}1615gitlab # [ 311.432736] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.242Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1616gitlab # [ 311.436827] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e877c53481f7a2f9684cf456","created_at":"2026-09-06T15:42:02.906Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45098b87d414bc419a77c04e71cff7f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.923Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e877c53481f7a2f9684cf456: done: 0.026625 sec","job_status":"done","queue_duration_s":1.301838,"scheduling_latency_s":1.301878,"redis_calls":8,"redis_duration_s":0.002043,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026625,"completed_at":"2026-09-06T15:42:04.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 311.481438] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bae9c36c584feeaeed50294f","created_at":"2026-09-06T15:42:02.973Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.992Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bae9c36c584feeaeed50294f: start","job_status":"start","queue_duration_s":1.261915,"scheduling_latency_s":1.261946}1618gitlab # [ 311.494824] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bae9c36c584feeaeed50294f","created_at":"2026-09-06T15:42:02.973Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:02.992Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bae9c36c584feeaeed50294f: done: 0.11954 sec","job_status":"done","queue_duration_s":1.261915,"scheduling_latency_s":1.261946,"redis_calls":65,"redis_duration_s":0.018789,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.002849,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000595,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014684,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11954,"completed_at":"2026-09-06T15:42:04.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 311.537035] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bacba7f00aaea2f9e653fbd8","created_at":"2026-09-06T15:42:03.012Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de7acadaf59a66cdaf0f00cc07ce36a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.030Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bacba7f00aaea2f9e653fbd8: start","job_status":"start","queue_duration_s":1.344923,"scheduling_latency_s":1.344942}1620gitlab # [ 311.551328] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bacba7f00aaea2f9e653fbd8","created_at":"2026-09-06T15:42:03.012Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de7acadaf59a66cdaf0f00cc07ce36a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.030Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bacba7f00aaea2f9e653fbd8: done: 0.020327 sec","job_status":"done","queue_duration_s":1.344923,"scheduling_latency_s":1.344942,"redis_calls":12,"redis_duration_s":0.001696,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024768,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.020327,"completed_at":"2026-09-06T15:42:04.395Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 311.597803] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ce2665da45c3e46ecc4ecc07","created_at":"2026-09-06T15:42:03.038Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6801c2823373f3826078efee5b298a76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:42:03.043Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ce2665da45c3e46ecc4ecc07: start","job_status":"start","queue_duration_s":1.353461,"scheduling_latency_s":1.353481}1622gitlab # [ 311.610951] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ce2665da45c3e46ecc4ecc07","created_at":"2026-09-06T15:42:03.038Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6801c2823373f3826078efee5b298a76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:42:03.043Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ce2665da45c3e46ecc4ecc07: done: 0.020977 sec","job_status":"done","queue_duration_s":1.353461,"scheduling_latency_s":1.353481,"redis_calls":8,"redis_duration_s":0.001083,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000117,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020977,"completed_at":"2026-09-06T15:42:04.417Z","load_balancing_strategy":"primary","db_duration_s":0.001363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 311.651664] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3793803104505613c2323413","created_at":"2026-09-06T15:42:03.051Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.058Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3793803104505613c2323413: start","job_status":"start","queue_duration_s":1.360121,"scheduling_latency_s":1.36014}1624gitlab # [ 311.665209] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3793803104505613c2323413","created_at":"2026-09-06T15:42:03.051Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.058Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3793803104505613c2323413: done: 0.026094 sec","job_status":"done","queue_duration_s":1.360121,"scheduling_latency_s":1.36014,"redis_calls":16,"redis_duration_s":0.002146,"redis_read_bytes":272,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000238,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026094,"completed_at":"2026-09-06T15:42:04.445Z","load_balancing_strategy":"primary","db_duration_s":0.000958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 311.707576] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"70050542943916648576e3f1","created_at":"2026-09-06T15:42:03.078Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac099c2859821d587ed37e3ac22fd64a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.084Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-70050542943916648576e3f1: start","job_status":"start","queue_duration_s":1.362085,"scheduling_latency_s":1.362105}1626gitlab # [ 311.721787] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"70050542943916648576e3f1","created_at":"2026-09-06T15:42:03.078Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac099c2859821d587ed37e3ac22fd64a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.084Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-70050542943916648576e3f1: done: 0.016187 sec","job_status":"done","queue_duration_s":1.362085,"scheduling_latency_s":1.362105,"redis_calls":8,"redis_duration_s":0.001871,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000123,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016187,"completed_at":"2026-09-06T15:42:04.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 311.763119] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c39db8a5073924b5b355debd","created_at":"2026-09-06T15:42:03.125Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"624531616496ddfd34b3e2b35570b1fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.145Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c39db8a5073924b5b355debd: start","job_status":"start","queue_duration_s":1.319235,"scheduling_latency_s":1.319254}1628gitlab # [ 311.777742] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.473Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1629gitlab # [ 311.782422] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c39db8a5073924b5b355debd","created_at":"2026-09-06T15:42:03.125Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"624531616496ddfd34b3e2b35570b1fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.145Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c39db8a5073924b5b355debd: done: 0.014296 sec","job_status":"done","queue_duration_s":1.319235,"scheduling_latency_s":1.319254,"redis_calls":8,"redis_duration_s":0.001284,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000122,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014296,"completed_at":"2026-09-06T15:42:04.478Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 311.824629] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"feda84ce6f3f0c38433c1ea5","created_at":"2026-09-06T15:42:03.183Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dba8d82f2cb18a13e458e7af4467591","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.189Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-feda84ce6f3f0c38433c1ea5: start","job_status":"start","queue_duration_s":1.290702,"scheduling_latency_s":1.290721}1631gitlab # [ 311.838095] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"feda84ce6f3f0c38433c1ea5","created_at":"2026-09-06T15:42:03.183Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dba8d82f2cb18a13e458e7af4467591","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.189Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-feda84ce6f3f0c38433c1ea5: done: 0.017031 sec","job_status":"done","queue_duration_s":1.290702,"scheduling_latency_s":1.290721,"redis_calls":8,"redis_duration_s":0.001099,"redis_read_bytes":133,"redis_write_bytes":859,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000128,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":98,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017031,"completed_at":"2026-09-06T15:42:04.497Z","load_balancing_strategy":"primary","db_duration_s":0.001126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 311.878816] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d51efac5d46a416bbdaa368d","created_at":"2026-09-06T15:42:03.227Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac948503d6b19544f012ae7c8fc9b76","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.235Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d51efac5d46a416bbdaa368d: start","job_status":"start","queue_duration_s":1.263115,"scheduling_latency_s":1.263134}1633gitlab # [ 311.894088] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d51efac5d46a416bbdaa368d","created_at":"2026-09-06T15:42:03.227Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac948503d6b19544f012ae7c8fc9b76","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.235Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d51efac5d46a416bbdaa368d: done: 0.31199 sec","job_status":"done","queue_duration_s":1.263115,"scheduling_latency_s":1.263134,"redis_calls":563,"redis_duration_s":0.061229000000000006,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.060407,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.283986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.31199,"completed_at":"2026-09-06T15:42:04.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 311.935834] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"737bddfc71f9f86fbf2eb111","created_at":"2026-09-06T15:42:03.251Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaec39605c42d3d7ffa5337655dcce15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-737bddfc71f9f86fbf2eb111: start","job_status":"start","queue_duration_s":1.54918,"scheduling_latency_s":1.549214}1635gitlab # [ 311.950527] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"737bddfc71f9f86fbf2eb111","created_at":"2026-09-06T15:42:03.251Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaec39605c42d3d7ffa5337655dcce15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.262Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-737bddfc71f9f86fbf2eb111: done: 0.013734 sec","job_status":"done","queue_duration_s":1.54918,"scheduling_latency_s":1.549214,"redis_calls":8,"redis_duration_s":0.001035,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013734,"completed_at":"2026-09-06T15:42:04.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 311.992617] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f5506b627129487448052354","created_at":"2026-09-06T15:42:03.306Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"279fc9efb82d9ac3afaef3b7da2f95e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.317Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f5506b627129487448052354: start","job_status":"start","queue_duration_s":1.509273,"scheduling_latency_s":1.509291}1637gitlab # [ 312.007912] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.834Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1638gitlab # [ 312.011691] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f5506b627129487448052354","created_at":"2026-09-06T15:42:03.306Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"279fc9efb82d9ac3afaef3b7da2f95e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.317Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f5506b627129487448052354: done: 0.013448 sec","job_status":"done","queue_duration_s":1.509273,"scheduling_latency_s":1.509291,"redis_calls":8,"redis_duration_s":0.001125,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00012,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013448,"completed_at":"2026-09-06T15:42:04.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 312.053625] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2486756728e71e3beec4e849","created_at":"2026-09-06T15:42:03.354Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59a041b9e6ced85d90a18c8354115370","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2486756728e71e3beec4e849: start","job_status":"start","queue_duration_s":1.474689,"scheduling_latency_s":1.474708}1640gitlab # [ 312.068108] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2486756728e71e3beec4e849","created_at":"2026-09-06T15:42:03.354Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59a041b9e6ced85d90a18c8354115370","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2486756728e71e3beec4e849: done: 0.032397 sec","job_status":"done","queue_duration_s":1.474689,"scheduling_latency_s":1.474708,"redis_calls":11,"redis_duration_s":0.001513,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000228,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044898,"exclusive_lock_hold_duration_s":0.01769028,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.032397,"completed_at":"2026-09-06T15:42:04.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 312.112542] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"1a22bddd20e8e56715ac04c9","created_at":"2026-09-06T15:42:03.376Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d2e686e44ae52265a7f32a44e93789d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.383Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-1a22bddd20e8e56715ac04c9: start","job_status":"start","queue_duration_s":1.491187,"scheduling_latency_s":1.491204}1642gitlab # [ 312.126627] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"1a22bddd20e8e56715ac04c9","created_at":"2026-09-06T15:42:03.376Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d2e686e44ae52265a7f32a44e93789d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:03.383Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-1a22bddd20e8e56715ac04c9: done: 0.01696 sec","job_status":"done","queue_duration_s":1.491187,"scheduling_latency_s":1.491204,"redis_calls":8,"redis_duration_s":0.00108,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000108,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01696,"completed_at":"2026-09-06T15:42:04.891Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 312.172202] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7f7b65b83669ae915a1eaa97","created_at":"2026-09-06T15:42:03.415Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5625f20dbaf56cd0b4a1df3c4b6f8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:42:03.420Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7f7b65b83669ae915a1eaa97: start","job_status":"start","queue_duration_s":1.472829,"scheduling_latency_s":1.472846}1644gitlab # [ 312.185768] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.901Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1645gitlab # [ 312.189481] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7f7b65b83669ae915a1eaa97","created_at":"2026-09-06T15:42:03.415Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-2e540f3a7c404193","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5625f20dbaf56cd0b4a1df3c4b6f8a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:42:03.420Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7f7b65b83669ae915a1eaa97: done: 0.013318 sec","job_status":"done","queue_duration_s":1.472829,"scheduling_latency_s":1.472846,"redis_calls":8,"redis_duration_s":0.001315,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000112,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013318,"completed_at":"2026-09-06T15:42:04.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 312.231811] gitaly[894]: time="2026-09-06T15:42:05.054Z" level=info msg="burden monitor stats" pid=8941647gitlab # [ 312.233167] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4833c19fb307671580a80970","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4833c19fb307671580a80970: start","job_status":"start","queue_duration_s":0.541493,"scheduling_latency_s":0.54151}1648gitlab # [ 312.245188] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4833c19fb307671580a80970","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4833c19fb307671580a80970: done: 0.015495 sec","job_status":"done","queue_duration_s":0.541493,"scheduling_latency_s":0.54151,"redis_calls":14,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000112,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015495,"completed_at":"2026-09-06T15:42:04.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 312.285543] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a9f80d7343c27ab6c51df93","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a9f80d7343c27ab6c51df93: start","job_status":"start","queue_duration_s":0.558198,"scheduling_latency_s":0.558216}1650gitlab # [ 312.297716] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a9f80d7343c27ab6c51df93","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a9f80d7343c27ab6c51df93: done: 0.014708 sec","job_status":"done","queue_duration_s":0.558198,"scheduling_latency_s":0.558216,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014708,"completed_at":"2026-09-06T15:42:04.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 312.336150] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29c54375d85a592b228a75d","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29c54375d85a592b228a75d: start","job_status":"start","queue_duration_s":0.574,"scheduling_latency_s":0.574017}1652gitlab # [ 312.348117] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29c54375d85a592b228a75d","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29c54375d85a592b228a75d: done: 0.014265 sec","job_status":"done","queue_duration_s":0.574,"scheduling_latency_s":0.574017,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014265,"completed_at":"2026-09-06T15:42:04.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 312.386541] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afd6b6ff233dca627c9db8c0","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afd6b6ff233dca627c9db8c0: start","job_status":"start","queue_duration_s":0.58934,"scheduling_latency_s":0.589357}1654gitlab # [ 312.398757] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afd6b6ff233dca627c9db8c0","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afd6b6ff233dca627c9db8c0: done: 0.014482 sec","job_status":"done","queue_duration_s":0.58934,"scheduling_latency_s":0.589357,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014482,"completed_at":"2026-09-06T15:42:04.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 312.437934] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa0f646b6997cb44f824f53e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa0f646b6997cb44f824f53e: start","job_status":"start","queue_duration_s":0.6049,"scheduling_latency_s":0.604917}1656gitlab # [ 312.450181] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa0f646b6997cb44f824f53e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa0f646b6997cb44f824f53e: done: 0.014453 sec","job_status":"done","queue_duration_s":0.6049,"scheduling_latency_s":0.604917,"redis_calls":13,"redis_duration_s":0.001808,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014453,"completed_at":"2026-09-06T15:42:04.985Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 312.488650] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:04.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42de13c1c4750ae433eca131","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42de13c1c4750ae433eca131: start","job_status":"start","queue_duration_s":0.620838,"scheduling_latency_s":0.620853}1658gitlab # [ 312.500834] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42de13c1c4750ae433eca131","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42de13c1c4750ae433eca131: done: 0.014253 sec","job_status":"done","queue_duration_s":0.620838,"scheduling_latency_s":0.620853,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014253,"completed_at":"2026-09-06T15:42:05.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 312.539058] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98d885893ba57d1fa9a69af","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98d885893ba57d1fa9a69af: start","job_status":"start","queue_duration_s":0.636164,"scheduling_latency_s":0.636181}1660gitlab # [ 312.551413] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98d885893ba57d1fa9a69af","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98d885893ba57d1fa9a69af: done: 0.014283 sec","job_status":"done","queue_duration_s":0.636164,"scheduling_latency_s":0.636181,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014283,"completed_at":"2026-09-06T15:42:05.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 312.589953] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c408b521eee1354580a15b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c408b521eee1354580a15b: start","job_status":"start","queue_duration_s":0.651631,"scheduling_latency_s":0.651649}1662gitlab # [ 312.602229] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c408b521eee1354580a15b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c408b521eee1354580a15b: done: 0.014314 sec","job_status":"done","queue_duration_s":0.651631,"scheduling_latency_s":0.651649,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014314,"completed_at":"2026-09-06T15:42:05.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 312.641646] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16c24173471e0ddeb04b4c2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16c24173471e0ddeb04b4c2: start","job_status":"start","queue_duration_s":0.667034,"scheduling_latency_s":0.667052}1664gitlab # [ 312.653906] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16c24173471e0ddeb04b4c2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16c24173471e0ddeb04b4c2: done: 0.014121 sec","job_status":"done","queue_duration_s":0.667034,"scheduling_latency_s":0.667052,"redis_calls":13,"redis_duration_s":0.001384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014121,"completed_at":"2026-09-06T15:42:05.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 312.692037] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad0e25432e5839c308783664","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad0e25432e5839c308783664: start","job_status":"start","queue_duration_s":0.682224,"scheduling_latency_s":0.682242}1666gitlab # [ 312.704124] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad0e25432e5839c308783664","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad0e25432e5839c308783664: done: 0.014693 sec","job_status":"done","queue_duration_s":0.682224,"scheduling_latency_s":0.682242,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014693,"completed_at":"2026-09-06T15:42:05.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 312.742315] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"913e31823bd166d1b217cba5","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-913e31823bd166d1b217cba5: start","job_status":"start","queue_duration_s":0.69813,"scheduling_latency_s":0.698147}1668gitlab # [ 312.754696] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"913e31823bd166d1b217cba5","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-913e31823bd166d1b217cba5: done: 0.015144 sec","job_status":"done","queue_duration_s":0.69813,"scheduling_latency_s":0.698147,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015144,"completed_at":"2026-09-06T15:42:05.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 312.792808] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"331308eb242685f589deddb1","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-331308eb242685f589deddb1: start","job_status":"start","queue_duration_s":0.714374,"scheduling_latency_s":0.714391}1670gitlab # [ 312.804895] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"331308eb242685f589deddb1","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-331308eb242685f589deddb1: done: 0.014508 sec","job_status":"done","queue_duration_s":0.714374,"scheduling_latency_s":0.714391,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014508,"completed_at":"2026-09-06T15:42:05.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 312.843678] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecd7da076290aae0d46934e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecd7da076290aae0d46934e: start","job_status":"start","queue_duration_s":0.729975,"scheduling_latency_s":0.729992}1672gitlab # [ 312.856899] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecd7da076290aae0d46934e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecd7da076290aae0d46934e: done: 0.014428 sec","job_status":"done","queue_duration_s":0.729975,"scheduling_latency_s":0.729992,"redis_calls":13,"redis_duration_s":0.001427,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014428,"completed_at":"2026-09-06T15:42:05.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 312.895070] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81b41de8036f49e34545b847","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81b41de8036f49e34545b847: start","job_status":"start","queue_duration_s":0.74551,"scheduling_latency_s":0.745527}1674gitlab # [ 312.907364] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81b41de8036f49e34545b847","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81b41de8036f49e34545b847: done: 0.014182 sec","job_status":"done","queue_duration_s":0.74551,"scheduling_latency_s":0.745527,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014182,"completed_at":"2026-09-06T15:42:05.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 312.945954] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47777662100e4d7a7163bc07","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47777662100e4d7a7163bc07: start","job_status":"start","queue_duration_s":0.760754,"scheduling_latency_s":0.760771}1676gitlab # [ 312.958223] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47777662100e4d7a7163bc07","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47777662100e4d7a7163bc07: done: 0.015578 sec","job_status":"done","queue_duration_s":0.760754,"scheduling_latency_s":0.760771,"redis_calls":13,"redis_duration_s":0.002742,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015578,"completed_at":"2026-09-06T15:42:05.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 312.996347] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b6c9748ff59c55fe2c297b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b6c9748ff59c55fe2c297b: start","job_status":"start","queue_duration_s":0.7774,"scheduling_latency_s":0.777417}1678gitlab # [ 313.008439] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7b6c9748ff59c55fe2c297b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7b6c9748ff59c55fe2c297b: done: 0.014078 sec","job_status":"done","queue_duration_s":0.7774,"scheduling_latency_s":0.777417,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014078,"completed_at":"2026-09-06T15:42:05.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 313.046967] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20dc03a8c049621de5820d38","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20dc03a8c049621de5820d38: start","job_status":"start","queue_duration_s":0.792551,"scheduling_latency_s":0.792567}1680gitlab # [ 313.060004] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20dc03a8c049621de5820d38","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20dc03a8c049621de5820d38: done: 0.014566 sec","job_status":"done","queue_duration_s":0.792551,"scheduling_latency_s":0.792567,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014566,"completed_at":"2026-09-06T15:42:05.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 313.098425] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc36ecb3cde11fa1090d4ba2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc36ecb3cde11fa1090d4ba2: start","job_status":"start","queue_duration_s":0.808184,"scheduling_latency_s":0.808201}1682gitlab # [ 313.110689] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc36ecb3cde11fa1090d4ba2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc36ecb3cde11fa1090d4ba2: done: 0.014161 sec","job_status":"done","queue_duration_s":0.808184,"scheduling_latency_s":0.808201,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014161,"completed_at":"2026-09-06T15:42:05.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 313.148876] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f1f8e5dca76908d538478b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f1f8e5dca76908d538478b: start","job_status":"start","queue_duration_s":0.823421,"scheduling_latency_s":0.823438}1684gitlab # [ 313.161049] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f1f8e5dca76908d538478b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f1f8e5dca76908d538478b: done: 0.014447 sec","job_status":"done","queue_duration_s":0.823421,"scheduling_latency_s":0.823438,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014447,"completed_at":"2026-09-06T15:42:05.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 313.199524] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e493c5d3e30c7f764ae773b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e493c5d3e30c7f764ae773b: start","job_status":"start","queue_duration_s":0.83907,"scheduling_latency_s":0.839087}1686gitlab # [ 313.211722] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e493c5d3e30c7f764ae773b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e493c5d3e30c7f764ae773b: done: 0.014108 sec","job_status":"done","queue_duration_s":0.83907,"scheduling_latency_s":0.839087,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014108,"completed_at":"2026-09-06T15:42:05.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 313.250218] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29885779d5c585d74f92b5e5","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29885779d5c585d74f92b5e5: start","job_status":"start","queue_duration_s":0.854286,"scheduling_latency_s":0.854303}1688gitlab # [ 313.263347] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29885779d5c585d74f92b5e5","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29885779d5c585d74f92b5e5: done: 0.014101 sec","job_status":"done","queue_duration_s":0.854286,"scheduling_latency_s":0.854303,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014101,"completed_at":"2026-09-06T15:42:05.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 313.301621] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4737b12b85f2a690a9399513","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4737b12b85f2a690a9399513: start","job_status":"start","queue_duration_s":0.86947,"scheduling_latency_s":0.869486}1690gitlab # [ 313.313806] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4737b12b85f2a690a9399513","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4737b12b85f2a690a9399513: done: 0.014297 sec","job_status":"done","queue_duration_s":0.86947,"scheduling_latency_s":0.869486,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014297,"completed_at":"2026-09-06T15:42:05.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 313.352115] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ae688ed0d64ecb71273a30","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ae688ed0d64ecb71273a30: start","job_status":"start","queue_duration_s":0.884833,"scheduling_latency_s":0.884849}1692gitlab # [ 313.364617] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ae688ed0d64ecb71273a30","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ae688ed0d64ecb71273a30: done: 0.014099 sec","job_status":"done","queue_duration_s":0.884833,"scheduling_latency_s":0.884849,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014099,"completed_at":"2026-09-06T15:42:05.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 313.403323] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f110e67e4634b4cdd1cd0ff2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f110e67e4634b4cdd1cd0ff2: start","job_status":"start","queue_duration_s":0.900081,"scheduling_latency_s":0.900098}1694gitlab # [ 313.415801] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f110e67e4634b4cdd1cd0ff2","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f110e67e4634b4cdd1cd0ff2: done: 0.014325 sec","job_status":"done","queue_duration_s":0.900081,"scheduling_latency_s":0.900098,"redis_calls":13,"redis_duration_s":0.001384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014325,"completed_at":"2026-09-06T15:42:05.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 313.454822] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e8b427ad3447324e22f7157","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e8b427ad3447324e22f7157: start","job_status":"start","queue_duration_s":0.915484,"scheduling_latency_s":0.915501}1696gitlab # [ 313.467244] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e8b427ad3447324e22f7157","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e8b427ad3447324e22f7157: done: 0.01439 sec","job_status":"done","queue_duration_s":0.915484,"scheduling_latency_s":0.915501,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01439,"completed_at":"2026-09-06T15:42:05.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 313.506793] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfea17ef02810cfd4679bf09","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfea17ef02810cfd4679bf09: start","job_status":"start","queue_duration_s":0.930959,"scheduling_latency_s":0.930978}1698gitlab # [ 313.519234] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfea17ef02810cfd4679bf09","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfea17ef02810cfd4679bf09: done: 0.014181 sec","job_status":"done","queue_duration_s":0.930959,"scheduling_latency_s":0.930978,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014181,"completed_at":"2026-09-06T15:42:05.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 313.558280] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b55280e48af7bde4323171","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b55280e48af7bde4323171: start","job_status":"start","queue_duration_s":0.946253,"scheduling_latency_s":0.946271}1700gitlab # [ 313.570635] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b55280e48af7bde4323171","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b55280e48af7bde4323171: done: 0.014204 sec","job_status":"done","queue_duration_s":0.946253,"scheduling_latency_s":0.946271,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014204,"completed_at":"2026-09-06T15:42:05.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 313.609549] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"050192e400466890c58b65f4","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-050192e400466890c58b65f4: start","job_status":"start","queue_duration_s":0.961506,"scheduling_latency_s":0.961522}1702gitlab # [ 313.621848] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"050192e400466890c58b65f4","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-050192e400466890c58b65f4: done: 0.01417 sec","job_status":"done","queue_duration_s":0.961506,"scheduling_latency_s":0.961522,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01417,"completed_at":"2026-09-06T15:42:05.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 313.660479] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a4da7b64ade87ce3b9275cf","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a4da7b64ade87ce3b9275cf: start","job_status":"start","queue_duration_s":0.976733,"scheduling_latency_s":0.97675}1704gitlab # [ 313.672602] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a4da7b64ade87ce3b9275cf","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a4da7b64ade87ce3b9275cf: done: 0.014044 sec","job_status":"done","queue_duration_s":0.976733,"scheduling_latency_s":0.97675,"redis_calls":13,"redis_duration_s":0.001367,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014044,"completed_at":"2026-09-06T15:42:05.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 313.712331] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936a212681b327224ca01910","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936a212681b327224ca01910: start","job_status":"start","queue_duration_s":0.991848,"scheduling_latency_s":0.991865}1706gitlab # [ 313.724864] postgres[3305]: [3305] ERROR: relation "table_without_models" does not exist1707gitlab # [ 313.725927] postgres[3305]: [3305] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1708gitlab # [ 313.727175] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936a212681b327224ca01910","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936a212681b327224ca01910: done: 0.014638 sec","job_status":"done","queue_duration_s":0.991848,"scheduling_latency_s":0.991865,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014638,"completed_at":"2026-09-06T15:42:05.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 313.765887] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"040399096fcfdddc9787e403","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-040399096fcfdddc9787e403: start","job_status":"start","queue_duration_s":1.007578,"scheduling_latency_s":1.007594}1710gitlab # [ 313.778166] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"040399096fcfdddc9787e403","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-040399096fcfdddc9787e403: done: 0.014371 sec","job_status":"done","queue_duration_s":1.007578,"scheduling_latency_s":1.007594,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014371,"completed_at":"2026-09-06T15:42:05.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 313.816646] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd363cbc44dc9ac90a2bfe36","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd363cbc44dc9ac90a2bfe36: start","job_status":"start","queue_duration_s":1.023044,"scheduling_latency_s":1.023061}1712gitlab # [ 313.828707] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd363cbc44dc9ac90a2bfe36","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd363cbc44dc9ac90a2bfe36: done: 0.014074 sec","job_status":"done","queue_duration_s":1.023044,"scheduling_latency_s":1.023061,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-09-06T15:42:05.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 313.867786] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"478a5b629c9c411b107b6b23","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-478a5b629c9c411b107b6b23: start","job_status":"start","queue_duration_s":1.038225,"scheduling_latency_s":1.038244}1714gitlab # [ 313.880185] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"478a5b629c9c411b107b6b23","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-478a5b629c9c411b107b6b23: done: 0.014071 sec","job_status":"done","queue_duration_s":1.038225,"scheduling_latency_s":1.038244,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014071,"completed_at":"2026-09-06T15:42:05.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 313.919597] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d5262474ee09b3c6d15f11a","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d5262474ee09b3c6d15f11a: start","job_status":"start","queue_duration_s":1.053348,"scheduling_latency_s":1.053364}1716gitlab # [ 313.932128] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d5262474ee09b3c6d15f11a","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d5262474ee09b3c6d15f11a: done: 0.014016 sec","job_status":"done","queue_duration_s":1.053348,"scheduling_latency_s":1.053364,"redis_calls":13,"redis_duration_s":0.001365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014016,"completed_at":"2026-09-06T15:42:05.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 313.970928] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6f0e3fdeb0eb804c19afc70","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6f0e3fdeb0eb804c19afc70: start","job_status":"start","queue_duration_s":1.068405,"scheduling_latency_s":1.068422}1718gitlab # [ 313.983127] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6f0e3fdeb0eb804c19afc70","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6f0e3fdeb0eb804c19afc70: done: 0.014385 sec","job_status":"done","queue_duration_s":1.068405,"scheduling_latency_s":1.068422,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014385,"completed_at":"2026-09-06T15:42:05.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 314.022137] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5ef3d2a2d7485ed5e1ad4b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5ef3d2a2d7485ed5e1ad4b: start","job_status":"start","queue_duration_s":1.083867,"scheduling_latency_s":1.083883}1720gitlab # [ 314.034488] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5ef3d2a2d7485ed5e1ad4b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5ef3d2a2d7485ed5e1ad4b: done: 0.01405 sec","job_status":"done","queue_duration_s":1.083867,"scheduling_latency_s":1.083883,"redis_calls":13,"redis_duration_s":0.001371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01405,"completed_at":"2026-09-06T15:42:05.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 314.073201] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6559d836ed8613e3a6eb9006","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6559d836ed8613e3a6eb9006: start","job_status":"start","queue_duration_s":1.099024,"scheduling_latency_s":1.099042}1722gitlab # [ 314.085461] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6559d836ed8613e3a6eb9006","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6559d836ed8613e3a6eb9006: done: 0.014755 sec","job_status":"done","queue_duration_s":1.099024,"scheduling_latency_s":1.099042,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014755,"completed_at":"2026-09-06T15:42:05.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 314.125379] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cd2cc375dd755e995bfdf11","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cd2cc375dd755e995bfdf11: start","job_status":"start","queue_duration_s":1.114866,"scheduling_latency_s":1.114901}1724gitlab # [ 314.137669] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cd2cc375dd755e995bfdf11","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cd2cc375dd755e995bfdf11: done: 0.014151 sec","job_status":"done","queue_duration_s":1.114866,"scheduling_latency_s":1.114901,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014151,"completed_at":"2026-09-06T15:42:05.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 314.176386] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279a2bdff7d0a220e53dc4ed","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279a2bdff7d0a220e53dc4ed: start","job_status":"start","queue_duration_s":1.130128,"scheduling_latency_s":1.130147}1726gitlab # [ 314.188582] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279a2bdff7d0a220e53dc4ed","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279a2bdff7d0a220e53dc4ed: done: 0.014079 sec","job_status":"done","queue_duration_s":1.130128,"scheduling_latency_s":1.130147,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014079,"completed_at":"2026-09-06T15:42:05.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 314.227317] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb64f9a07c826a4df9da38c1","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb64f9a07c826a4df9da38c1: start","job_status":"start","queue_duration_s":1.145246,"scheduling_latency_s":1.145263}1728gitlab # [ 314.239488] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb64f9a07c826a4df9da38c1","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb64f9a07c826a4df9da38c1: done: 0.013987 sec","job_status":"done","queue_duration_s":1.145246,"scheduling_latency_s":1.145263,"redis_calls":13,"redis_duration_s":0.0013839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013987,"completed_at":"2026-09-06T15:42:05.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729gitlab # [ 314.278700] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ffb2bbdfdcf87a16eb3ea19","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ffb2bbdfdcf87a16eb3ea19: start","job_status":"start","queue_duration_s":1.160277,"scheduling_latency_s":1.160294}1730gitlab # [ 314.291187] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ffb2bbdfdcf87a16eb3ea19","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ffb2bbdfdcf87a16eb3ea19: done: 0.013987 sec","job_status":"done","queue_duration_s":1.160277,"scheduling_latency_s":1.160294,"redis_calls":13,"redis_duration_s":0.0014130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013987,"completed_at":"2026-09-06T15:42:05.540Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 314.330991] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b92bca80c5ba5e016fd61e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b92bca80c5ba5e016fd61e: start","job_status":"start","queue_duration_s":1.175335,"scheduling_latency_s":1.175352}1732gitlab # [ 314.343431] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b92bca80c5ba5e016fd61e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b92bca80c5ba5e016fd61e: done: 0.014061 sec","job_status":"done","queue_duration_s":1.175335,"scheduling_latency_s":1.175352,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014061,"completed_at":"2026-09-06T15:42:05.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 314.382460] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27011ce88fa6eb5cee09a313","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27011ce88fa6eb5cee09a313: start","job_status":"start","queue_duration_s":1.190493,"scheduling_latency_s":1.19051}1734gitlab # [ 314.394692] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27011ce88fa6eb5cee09a313","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27011ce88fa6eb5cee09a313: done: 0.014757 sec","job_status":"done","queue_duration_s":1.190493,"scheduling_latency_s":1.19051,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014757,"completed_at":"2026-09-06T15:42:05.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1735gitlab # [ 314.433060] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ba5c0531fb30bc27abdadc4","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ba5c0531fb30bc27abdadc4: start","job_status":"start","queue_duration_s":1.206336,"scheduling_latency_s":1.206353}1736gitlab # [ 314.445168] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ba5c0531fb30bc27abdadc4","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ba5c0531fb30bc27abdadc4: done: 0.014083 sec","job_status":"done","queue_duration_s":1.206336,"scheduling_latency_s":1.206353,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014083,"completed_at":"2026-09-06T15:42:05.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737gitlab # [ 314.483363] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6ed94f1c6c6edee03c896ab","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6ed94f1c6c6edee03c896ab: start","job_status":"start","queue_duration_s":1.221491,"scheduling_latency_s":1.221509}1738gitlab # [ 314.495604] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6ed94f1c6c6edee03c896ab","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6ed94f1c6c6edee03c896ab: done: 0.014383 sec","job_status":"done","queue_duration_s":1.221491,"scheduling_latency_s":1.221509,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014383,"completed_at":"2026-09-06T15:42:05.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739gitlab # [ 314.534559] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528bcf64eb5ceb44dd676644","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528bcf64eb5ceb44dd676644: start","job_status":"start","queue_duration_s":1.236928,"scheduling_latency_s":1.236945}1740gitlab # [ 314.546767] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528bcf64eb5ceb44dd676644","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528bcf64eb5ceb44dd676644: done: 0.014078 sec","job_status":"done","queue_duration_s":1.236928,"scheduling_latency_s":1.236945,"redis_calls":13,"redis_duration_s":0.0013839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014078,"completed_at":"2026-09-06T15:42:05.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741gitlab # [ 314.585481] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71ea3c2d28bea0b70551ba33","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71ea3c2d28bea0b70551ba33: start","job_status":"start","queue_duration_s":1.252081,"scheduling_latency_s":1.252098}1742gitlab # [ 314.597463] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71ea3c2d28bea0b70551ba33","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71ea3c2d28bea0b70551ba33: done: 0.014074 sec","job_status":"done","queue_duration_s":1.252081,"scheduling_latency_s":1.252098,"redis_calls":13,"redis_duration_s":0.0013679999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-09-06T15:42:05.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743gitlab # [ 314.636295] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8cc5f1347b65b79b2c708b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8cc5f1347b65b79b2c708b: start","job_status":"start","queue_duration_s":1.267245,"scheduling_latency_s":1.267263}1744gitlab # [ 314.648319] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb8cc5f1347b65b79b2c708b","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb8cc5f1347b65b79b2c708b: done: 0.013968 sec","job_status":"done","queue_duration_s":1.267245,"scheduling_latency_s":1.267263,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013968,"completed_at":"2026-09-06T15:42:05.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1745gitlab # [ 314.686224] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9ca33ffab14d290054822e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9ca33ffab14d290054822e: start","job_status":"start","queue_duration_s":1.28233,"scheduling_latency_s":1.282348}1746gitlab # [ 314.698394] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9ca33ffab14d290054822e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9ca33ffab14d290054822e: done: 0.014405 sec","job_status":"done","queue_duration_s":1.28233,"scheduling_latency_s":1.282348,"redis_calls":13,"redis_duration_s":0.0015310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014405,"completed_at":"2026-09-06T15:42:05.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1747gitlab # [ 314.737601] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbe79360accefbea04b5df4e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbe79360accefbea04b5df4e: start","job_status":"start","queue_duration_s":1.297816,"scheduling_latency_s":1.297834}1748gitlab # [ 314.750111] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbe79360accefbea04b5df4e","created_at":"2026-09-06T15:42:04.273Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-fe6b112ef62e4058","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bb9ce30ea617b95656036b39c90a6ab6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.366Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbe79360accefbea04b5df4e: done: 0.014423 sec","job_status":"done","queue_duration_s":1.297816,"scheduling_latency_s":1.297834,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014423,"completed_at":"2026-09-06T15:42:05.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1749gitlab # [ 314.788186] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.679Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc6721e602f6ff295f7092de","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc6721e602f6ff295f7092de: start","job_status":"start","queue_duration_s":1.239885,"scheduling_latency_s":1.239902}1750gitlab # [ 314.800016] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.690Z","message":"No existing merge request to be cleaned up."}1751gitlab # [ 314.801641] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.699Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc6721e602f6ff295f7092de","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc6721e602f6ff295f7092de: done: 0.019685 sec","job_status":"done","queue_duration_s":1.239885,"scheduling_latency_s":1.239902,"redis_calls":11,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019685,"completed_at":"2026-09-06T15:42:05.699Z","load_balancing_strategy":"primary","db_duration_s":0.001559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1752gitlab # [ 314.841035] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e3f7c3f149b6138dd6c24ea","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e3f7c3f149b6138dd6c24ea: start","job_status":"start","queue_duration_s":1.260674,"scheduling_latency_s":1.260691}1753gitlab # [ 314.853068] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.710Z","message":"No existing merge request to be cleaned up."}1754gitlab # [ 314.854674] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.718Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e3f7c3f149b6138dd6c24ea","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e3f7c3f149b6138dd6c24ea: done: 0.017944 sec","job_status":"done","queue_duration_s":1.260674,"scheduling_latency_s":1.260691,"redis_calls":10,"redis_duration_s":0.0012929999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000722,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017944,"completed_at":"2026-09-06T15:42:05.718Z","load_balancing_strategy":"primary","db_duration_s":0.00133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755gitlab # [ 314.892157] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.719Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"001e72496f5f1943c6c6108c","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-001e72496f5f1943c6c6108c: start","job_status":"start","queue_duration_s":1.279699,"scheduling_latency_s":1.279717}1756gitlab # [ 314.904133] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.729Z","message":"No existing merge request to be cleaned up."}1757gitlab # [ 314.906747] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.737Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"001e72496f5f1943c6c6108c","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-001e72496f5f1943c6c6108c: done: 0.018019 sec","job_status":"done","queue_duration_s":1.279699,"scheduling_latency_s":1.279717,"redis_calls":10,"redis_duration_s":0.001314,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018019,"completed_at":"2026-09-06T15:42:05.737Z","load_balancing_strategy":"primary","db_duration_s":0.001247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 314.944486] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.738Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1578bfdd911b281fbcd218d0","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1578bfdd911b281fbcd218d0: start","job_status":"start","queue_duration_s":1.298803,"scheduling_latency_s":1.29882}1759gitlab # [ 314.956169] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.748Z","message":"No existing merge request to be cleaned up."}1760gitlab # [ 314.957799] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:05.756Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1578bfdd911b281fbcd218d0","created_at":"2026-09-06T15:42:04.430Z","trace_propagation_headers":{"sentry-trace":"bf7e29c1265046eb86f8dc22ad9b1c67-e880dea67aaf4732","baggage":"sentry-trace_id=bf7e29c1265046eb86f8dc22ad9b1c67,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37877bb374f3e25c0c2fef9b37ad34a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:04.439Z","job_size_bytes":2,"pid":2011,"sidekiq_tid":"mapf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1578bfdd911b281fbcd218d0: done: 0.018256 sec","job_status":"done","queue_duration_s":1.298803,"scheduling_latency_s":1.29882,"redis_calls":10,"redis_duration_s":0.001362,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018256,"completed_at":"2026-09-06T15:42:05.756Z","load_balancing_strategy":"primary","db_duration_s":0.001475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761gitlab # [ 319.265197] runuser[2965]: pam_unix(runuser:session): session closed for user gitlab1762gitlab # [ 319.267277] setup-gitlab-start[2948]: + systemctl restart gitlab-sidekiq.service1763gitlab # [ 319.300925] systemd[1]: Stopping gitlab-sidekiq.service...1764gitlab # [ 319.307496] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:12.222Z","message":"Shutting down"}1765gitlab # [ 319.311880] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:12.223Z","message":"Scheduler exiting..."}1766gitlab # [ 319.316294] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:12.224Z","message":"Terminating quiet threads for default capsule"}1767gitlab # [ 319.321318] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:12.224Z","message":"Scheduler exiting..."}1768gitlab # [ 319.809647] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:12.725Z","message":"Pausing to allow jobs to finish..."}1769gitlab # [ 323.314973] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:16.230Z","message":"Bye!"}1770gitlab # [ 323.385664] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-09-06T15:42:16.301Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2011,"worker_id":"sidekiq_0","memwd_rss_bytes":972320768,"retry":0}1771gitlab # [ 323.978779] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1772gitlab # [ 323.979503] systemd[1]: Stopped gitlab-sidekiq.service.1773gitlab # [ 323.979745] systemd[1]: gitlab-sidekiq.service: Consumed 1min 56.440s CPU time over 3min 21.119s wall clock time, 956.6M memory peak, 4.5M read from disk.1774gitlab # [ 323.993597] systemd[1]: Started gitlab-sidekiq.service.1775gitlab # [ 323.997784] setup-gitlab-start[2948]: + mkdir -p /var/lib/secrets1776gitlab # [ 324.003034] setup-gitlab-start[2948]: + echo nixbot-test-token-of-20-chars1777gitlab # [ 324.006042] setup-gitlab-start[2948]: + chmod 644 /var/lib/secrets/gitlab-token1778gitlab # [ 324.009105] setup-gitlab-start[2948]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1779gitlab # [ 325.268426] gitaly[894]: time="2026-09-06T15:42:18.183Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.182" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 325.268847] gitaly[894]: time="2026-09-06T15:42:18.184Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.182" grpc.time_ms=1.552 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 325.540905] gitaly[894]: time="2026-09-06T15:42:18.457Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.286" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.456" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 325.571318] gitaly[894]: time="2026-09-06T15:42:18.457Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.286" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.456" grpc.time_ms=0.625 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 325.636180] gitaly[894]: time="2026-09-06T15:42:18.552Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R diskcache=8e7daa75-ede3-452b-b2d5-c4b9a37a2c4a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:42:28.010" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.480" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 325.663496] gitaly[894]: time="2026-09-06T15:42:18.553Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=40 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=46 command.spawn_token_fork_ms=6 command.system_time_ms=30 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:42:28.010" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.480" grpc.time_ms=72.185 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 325.687427] gitaly[894]: time="2026-09-06T15:42:18.578Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.577" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1786gitlab # [ 325.702288] gitaly[894]: time="2026-09-06T15:42:18.579Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.577" grpc.time_ms=1.532 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 325.716846] gitaly[894]: time="2026-09-06T15:42:18.607Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:42:28.116" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.588" grpc.time_ms=19.053 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 325.796845] gitaly[894]: time="2026-09-06T15:42:18.713Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.712" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 325.825876] gitaly[894]: time="2026-09-06T15:42:18.713Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.712" grpc.time_ms=0.643 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 325.876874] gitaly[894]: time="2026-09-06T15:42:18.793Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R diskcache=b947e4ad-2e81-4de8-87d0-d9c8ac66c1f0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:42:28.255" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.725" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 325.896863] gitaly[894]: time="2026-09-06T15:42:18.793Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=40 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=46 command.spawn_token_fork_ms=4 command.system_time_ms=37 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T15:42:28.255" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.725" grpc.time_ms=67.99 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 325.919250] gitaly[894]: time="2026-09-06T15:42:18.814Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.813" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1793gitlab # [ 325.933354] gitaly[894]: time="2026-09-06T15:42:18.815Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.813" grpc.time_ms=1.271 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 325.947787] gitaly[894]: time="2026-09-06T15:42:18.840Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:42:28.012" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.822" grpc.time_ms=17.193 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 325.995340] gitaly[894]: time="2026-09-06T15:42:18.912Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:42:28.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.911" grpc.time_ms=0.383 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 326.016551] gitaly[894]: time="2026-09-06T15:42:18.929Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:42:28.117" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:18.927" grpc.time_ms=0.824 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 327.050830] gitaly[894]: time="2026-09-06T15:42:19.965Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP4XVVTRY18SXK2AKRDY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:42:29.140" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:19.950" grpc.time_ms=14.89 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 329.153860] sidekiq-cluster[3364]: {"severity":"INFO","time":"2026-09-06T15:42:22.030Z","message":"Starting cluster with 1 processes"}1799gitlab # [ 329.285035] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:22 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 52441800gitlab # [ 329.293424] setup-gitlab-start[2948]: + mkdir -p /tmp/test-flake1801gitlab # [ 329.298688] setup-gitlab-start[2948]: + cd /tmp/test-flake1802gitlab # [ 329.299494] setup-gitlab-start[2948]: + git init -b master1803gitlab # [ 329.325849] setup-gitlab-start[3433]: Initialized empty Git repository in /tmp/test-flake/.git/1804gitlab # [ 329.327170] setup-gitlab-start[2948]: + git config user.name test1805gitlab # [ 329.334244] setup-gitlab-start[2948]: + git config user.email test@example.com1806gitlab # [ 329.341788] setup-gitlab-start[2948]: + cat1807gitlab # [ 329.347207] setup-gitlab-start[2948]: + git add flake.nix1808gitlab # [ 329.355778] setup-gitlab-start[2948]: + git commit -m 'initial commit'1809gitlab # [ 329.381035] setup-gitlab-start[3439]: [master (root-commit) f3cef85] initial commit1810gitlab # [ 329.384972] setup-gitlab-start[3439]: 1 file changed, 10 insertions(+)1811gitlab # [ 329.387748] setup-gitlab-start[3439]: create mode 100644 flake.nix1812gitlab # [ 329.390551] setup-gitlab-start[2948]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1813gitlab # [ 329.395384] setup-gitlab-start[2948]: + git push -u origin master1814gitlab # [ 329.509871] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 741815gitlab # [ 329.716400] gitaly[894]: time="2026-09-06T15:42:22.632Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5371MVEDTHR4234AS9NT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:22.616" grpc.time_ms=15.397 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1816gitlab # [ 329.739818] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2001817gitlab # [ 330.795630] gitaly[894]: time="2026-09-06T15:42:23.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:42:33.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:23.695" grpc.time_ms=15.845 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 330.923883] gitaly[894]: time="2026-09-06T15:42:23.840Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T15:42:53.022" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T15:42:23.822" grpc.time_ms=17.326 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 330.984614] gitaly[894]: time="2026-09-06T15:42:23.901Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM duration_ms=377ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1820gitlab # [ 331.039279] gitaly[894]: time="2026-09-06T15:42:23.955Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM duration_ms=53ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1821gitlab # [ 331.054203] gitaly[894]: time="2026-09-06T15:42:23.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:23.521" grpc.time_ms=435.213 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1822gitlab # [ 331.115601] gitaly[894]: time="2026-09-06T15:42:24.032Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:24.029" grpc.time_ms=2.687 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1823gitlab # [ 331.167822] gitaly[894]: time="2026-09-06T15:42:24.084Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:24.083" grpc.time_ms=1.089 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1824gitlab # [ 331.215926] gitaly[894]: time="2026-09-06T15:42:24.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:24.131" grpc.time_ms=0.963 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1825gitlab # [ 331.479063] gitaly[894]: time="2026-09-06T15:42:24.395Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:42:34.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:24.378" grpc.time_ms=17.323 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 331.562678] gitaly[894]: time="2026-09-06T15:42:24.479Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=5 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T15:42:34.072" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:24.443" grpc.time_ms=35.825 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 331.604076] gitaly[894]: time="2026-09-06T15:42:24.499Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM duration_ms=294ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1828gitlab # [ 331.612891] gitaly[894]: time="2026-09-06T15:42:24.500Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:24.203" grpc.time_ms=297.366 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1829gitlab # [ 331.637566] gitaly[894]: time="2026-09-06T15:42:24.517Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM diskcache=9c678bfa-90ad-4031-a22f-8ad9e265a79f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:23.401" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1830gitlab # [ 331.655593] setup-gitlab-start[3443]: To http://gitlab/root/test-flake.git1831gitlab # [ 331.657510] setup-gitlab-start[3443]: * [new branch] master -> master1832gitlab # [ 331.659119] setup-gitlab-start[3443]: branch 'master' set up to track 'origin/master'.1833gitlab # [ 331.662475] gitlab-workhorse[821]: time="2026-09-06T15:42:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521834gitlab # [ 331.665449] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:24 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 18611835gitlab # [ 331.668758] systemd[1]: Finished setup-gitlab.service.1836gitlab # [ 331.669918] gitaly[894]: time="2026-09-06T15:42:24.517Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=343 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13435 command.oublock=32 command.real_time_ms=1107 command.spawn_token_fork_ms=2 command.system_time_ms=179 command.user_time_ms=164 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:23.401" grpc.time_ms=1115.439 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1837gitlab # [ 331.690678] systemd[1]: Starting nixbot CI service...1838gitlab: (finished: waiting for unit setup-gitlab.service, in 332.90 seconds)1839gitlab: waiting for unit nixbot.service1840gitlab # [ 333.342207] nixbot[3536]: {"ts": "2026-09-06T15:42:26.257Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1841gitlab # [ 333.366885] nixbot[3536]: {"ts": "2026-09-06T15:42:26.283Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1842gitlab # [ 333.384052] nixbot[3536]: {"ts": "2026-09-06T15:42:26.300Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1843gitlab # [ 333.390617] nixbot[3536]: {"ts": "2026-09-06T15:42:26.305Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1844gitlab # [ 333.397469] nixbot[3536]: {"ts": "2026-09-06T15:42:26.309Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1845gitlab # [ 333.403833] nixbot[3536]: {"ts": "2026-09-06T15:42:26.315Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1846gitlab # [ 333.410962] nixbot[3536]: {"ts": "2026-09-06T15:42:26.320Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1847gitlab # [ 333.418079] nixbot[3536]: {"ts": "2026-09-06T15:42:26.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1848gitlab # [ 333.424556] nixbot[3536]: {"ts": "2026-09-06T15:42:26.328Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1849gitlab # [ 333.431206] nixbot[3536]: {"ts": "2026-09-06T15:42:26.330Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1850gitlab # [ 333.438275] nixbot[3536]: {"ts": "2026-09-06T15:42:26.335Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1851gitlab # [ 333.444707] nixbot[3536]: {"ts": "2026-09-06T15:42:26.341Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1852gitlab # [ 333.451265] nixbot[3536]: {"ts": "2026-09-06T15:42:26.344Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1853gitlab # [ 333.457296] nixbot[3536]: {"ts": "2026-09-06T15:42:26.346Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1854gitlab # [ 333.463076] nixbot[3536]: {"ts": "2026-09-06T15:42:26.350Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1855gitlab # [ 333.468851] nixbot[3536]: {"ts": "2026-09-06T15:42:26.353Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1856gitlab # [ 333.474391] nixbot[3536]: {"ts": "2026-09-06T15:42:26.354Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1857gitlab # [ 333.480094] nixbot[3536]: {"ts": "2026-09-06T15:42:26.356Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1858gitlab # [ 333.484836] nixbot[3536]: {"ts": "2026-09-06T15:42:26.360Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1859gitlab # [ 333.489746] nixbot[3536]: {"ts": "2026-09-06T15:42:26.363Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1860gitlab # [ 333.494550] nixbot[3536]: {"ts": "2026-09-06T15:42:26.365Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1861gitlab # [ 333.499220] nixbot[3536]: {"ts": "2026-09-06T15:42:26.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1862gitlab # [ 333.504783] nixbot[3536]: {"ts": "2026-09-06T15:42:26.377Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1863gitlab # [ 333.509227] nixbot[3536]: {"ts": "2026-09-06T15:42:26.379Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1864gitlab # [ 333.514174] nixbot[3536]: {"ts": "2026-09-06T15:42:26.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1865gitlab # [ 333.518500] nixbot[3536]: {"ts": "2026-09-06T15:42:26.384Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1866gitlab # [ 333.522801] nixbot[3536]: {"ts": "2026-09-06T15:42:26.386Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1867gitlab # [ 333.526882] nixbot[3536]: {"ts": "2026-09-06T15:42:26.388Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1868gitlab # [ 333.530808] nixbot[3536]: {"ts": "2026-09-06T15:42:26.389Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1869gitlab # [ 333.534565] nixbot[3536]: {"ts": "2026-09-06T15:42:26.415Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1870gitlab # [ 333.543583] nixbot[3536]: {"ts": "2026-09-06T15:42:26.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1871gitlab # [ 333.549238] nixbot[3536]: {"ts": "2026-09-06T15:42:26.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1872gitlab # [ 333.552530] nixbot[3536]: {"ts": "2026-09-06T15:42:26.424Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1873gitlab # [ 333.973334] nixbot[3536]: INFO: Started server process [3536]1874gitlab # [ 333.976678] nixbot[3536]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1875gitlab # [ 334.000753] nixbot[3536]: INFO: ::ffff:127.0.0.1:41360 - "GET /health HTTP/1.1" 200 OK1876gitlab # [ 334.010031] systemd[1]: Started nixbot CI service.1877gitlab # [ 334.014427] systemd[1]: Reached target Multi-User System.1878gitlab # [ 334.017149] systemd[1]: Startup finished in 722ms (kernel) + 4.824s (initrd) + 5min 28.470s (userspace) = 5min 34.016s.1879gitlab # [ 334.301198] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:27 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2971880gitlab # [ 334.308436] nixbot[3536]: {"ts": "2026-09-06T15:42:27.216Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1881gitlab # [ 334.358515] nixbot[3536]: {"ts": "2026-09-06T15:42:27.273Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1882gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds)1883gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1884gitlab # [ 334.585521] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2121885gitlab # [ 334.589165] nixbot[3536]: {"ts": "2026-09-06T15:42:27.504Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1886gitlab # [ 334.593103] nixbot[3536]: {"ts": "2026-09-06T15:42:27.509Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1887gitlab # [ 334.623085] nixbot[3536]: INFO: ::ffff:127.0.0.1:41364 - "GET /health HTTP/1.1" 200 OK1888gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1889subtest: project discovered and webhook registered1890gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1891gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.14 seconds)1892gitlab # [ 334.767529] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 871893gitlab # [ 334.786932] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1881894gitlab # [ 334.791957] nixbot[3536]: {"ts": "2026-09-06T15:42:27.704Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1895gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1896gitlab # [ 335.866424] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:28 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 10661897gitlab # [ 335.867387] nixbot[3536]: {"ts": "2026-09-06T15:42:28.783Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1898gitlab # [ 335.966576] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1411899gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1900(finished: subtest: project discovered and webhook registered, in 1.35 seconds)1901subtest: push delivers the webhook1902gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1903gitlab # [ 335.994891] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1101904gitlab # [ 335.999422] nixbot[3536]: {"ts": "2026-09-06T15:42:28.912Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1905gitlab # [ 336.091128] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 431906gitlab # [ 336.103910] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1041907gitlab # [ 336.117392] nixbot[3536]: {"ts": "2026-09-06T15:42:29.028Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1908gitlab # [ 336.201789] gitaly[894]: time="2026-09-06T15:42:29.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59MMW6G6SBA47097GGJX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.105" grpc.time_ms=12.125 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1909gitlab # [ 336.220207] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 1061910gitlab # Enumerating objects: 5, done.1911gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1912gitlab # Delta compression using up to 4 threads1913gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1914gitlab # [ 336.243190] gitaly[894]: time="2026-09-06T15:42:29.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59NSP6XZ9SPREJ9PE02G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-06T15:42:59.040" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:29.140" grpc.time_ms=19.041 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 13.00 KiB/s, done.1916gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1917gitlab # [ 336.277785] gitaly[894]: time="2026-09-06T15:42:29.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59NSP6XZ9SPREJ9PE02G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:42:59.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:29.193" grpc.time_ms=1.014 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918gitlab # [ 336.319085] gitaly[894]: time="2026-09-06T15:42:29.235Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59NSP6XZ9SPREJ9PE02G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-06T15:42:39.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:29.223" grpc.time_ms=11.709 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 336.400345] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2661920gitlab # [ 336.406068] nixbot[3536]: {"ts": "2026-09-06T15:42:29.318Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1921gitlab # [ 336.544499] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1321922gitlab # [ 336.548170] nixbot[3536]: {"ts": "2026-09-06T15:42:29.464Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1923gitlab # [ 336.555722] nixbot[3536]: {"ts": "2026-09-06T15:42:29.472Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1924gitlab # [ 336.651922] gitaly[894]: time="2026-09-06T15:42:29.568Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T15:42:59.056" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T15:42:29.557" grpc.time_ms=10.916 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 336.691699] gitaly[894]: time="2026-09-06T15:42:29.608Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5A4T496C77SNH6QAE2HS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.600" grpc.time_ms=8.188 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1926gitlab # [ 336.710820] gitaly[894]: time="2026-09-06T15:42:29.626Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN duration_ms=172ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1927gitlab # [ 336.714638] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 771928gitlab # [ 336.744300] gitaly[894]: time="2026-09-06T15:42:29.661Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN duration_ms=34ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1929gitlab # [ 336.749618] gitaly[894]: time="2026-09-06T15:42:29.661Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:29.453" grpc.time_ms=207.695 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1930gitlab # [ 336.800842] gitaly[894]: time="2026-09-06T15:42:29.717Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:29.716" grpc.time_ms=1.098 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1931gitlab # [ 336.846699] gitaly[894]: time="2026-09-06T15:42:29.763Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:29.761" grpc.time_ms=1.751 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1932gitlab # [ 336.867709] gitaly[894]: time="2026-09-06T15:42:29.773Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5A7WXNKPYPAYZXYEBKWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.761" pid=894 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1933gitlab # [ 336.882890] gitlab-workhorse[821]: time="2026-09-06T15:42:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131934gitlab # [ 336.885475] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1451935gitlab # [ 336.887967] gitaly[894]: time="2026-09-06T15:42:29.773Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5A7WXNKPYPAYZXYEBKWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.761" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1936gitlab # [ 336.904591] gitaly[894]: time="2026-09-06T15:42:29.773Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5A7WXNKPYPAYZXYEBKWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.761" grpc.time_ms=11.862 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 336.920693] gitaly[894]: time="2026-09-06T15:42:29.821Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:29.821" grpc.time_ms=0.588 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 336.972171] gitaly[894]: time="2026-09-06T15:42:29.888Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5ACHXF4DVJWFY6GPPMMY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.872" pid=894 remote_ip="2001:db8:1::1" request_sha=e88c4af0b0a9e144b16e55e286ea8a8ab8962725 response_bytes=223 span.kind=server system=grpc1939gitlab # [ 336.989229] gitaly[894]: time="2026-09-06T15:42:29.889Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5ACHXF4DVJWFY6GPPMMY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.872" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 337.009367] gitlab-workhorse[821]: time="2026-09-06T15:42:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231941gitlab # [ 337.012092] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1111942gitlab # [ 337.014601] gitaly[894]: time="2026-09-06T15:42:29.889Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5ACHXF4DVJWFY6GPPMMY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.872" grpc.time_ms=17.145 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1943gitlab # [ 337.045331] gitaly[894]: time="2026-09-06T15:42:29.962Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN duration_ms=96ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1944gitlab # [ 337.049035] gitaly[894]: time="2026-09-06T15:42:29.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:29.865" grpc.time_ms=97.137 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1945gitlab # To http://gitlab/root/test-flake.git1946gitlab # [ 337.063173] gitaly[894]: time="2026-09-06T15:42:29.973Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN diskcache=0ffb0793-b2de-4d2b-b6b6-cc69118bb2aa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.353" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1947gitlab # f3cef85..631e520 [ 337.076395] gitlab-workhorse[821]: time="2026-09-06T15:42:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521948gitlab # master -> master[ 337.078756] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7891949gitlab # 1950gitlab # [ 337.081572] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 631951gitlab # [ 337.084291] gitaly[894]: time="2026-09-06T15:42:29.973Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=236 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13094 command.oublock=32 command.real_time_ms=613 command.spawn_token_fork_ms=2 command.system_time_ms=133 command.user_time_ms=103 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.353" grpc.time_ms=620.448 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1952gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.14 seconds)1953gitlab: must succeed: git -C /tmp/test-flake rev-parse master1954gitlab # [ 337.100200] gitaly[894]: time="2026-09-06T15:42:29.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5AH6C78YDY6DACTQH8CF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:29.980" grpc.time_ms=8.62 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'1957gitlab # [ 337.151889] gitaly[894]: time="2026-09-06T15:42:30.068Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AK71A48Z8QSPMT969G5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.060" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1958gitlab # [ 337.164409] gitaly[894]: time="2026-09-06T15:42:30.069Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AK71A48Z8QSPMT969G5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.060" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 337.180338] gitlab-workhorse[821]: time="2026-09-06T15:42:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671960gitlab # [ 337.182332] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 851961gitlab # [ 337.184446] gitaly[894]: time="2026-09-06T15:42:30.070Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AK71A48Z8QSPMT969G5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.060" grpc.time_ms=9.495 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 337.202659] nixbot[3536]: INFO: ::ffff:127.0.0.1:41368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.08 seconds)1964gitlab # [ 337.241528] gitaly[894]: time="2026-09-06T15:42:30.157Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AP2M4B9VPZE12CV56HE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.142" pid=894 remote_ip="2001:db8:1::1" request_sha=31db718b07c1ab9f50331bbdd2c28173f660b148 response_bytes=336 span.kind=server system=grpc1965gitlab # [ 337.253038] gitaly[894]: time="2026-09-06T15:42:30.157Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AP2M4B9VPZE12CV56HE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.142" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1966gitlab # [ 337.266774] gitlab-workhorse[821]: time="2026-09-06T15:42:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361967gitlab # [ 337.268779] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 761968gitlab # [ 337.270635] gitaly[894]: time="2026-09-06T15:42:30.158Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AP2M4B9VPZE12CV56HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.142" grpc.time_ms=15.391 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1969gitlab # [ 337.352972] gitaly[894]: time="2026-09-06T15:42:30.269Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5ASXQGS42X050NKP95SM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.261" grpc.time_ms=8.119 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1970gitlab # [ 337.386788] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641971gitlab # [ 337.455112] gitaly[894]: time="2026-09-06T15:42:30.371Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AVZ8T8QHTC4CSC1C1DJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.338" pid=894 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1972gitlab # [ 337.488736] gitaly[894]: time="2026-09-06T15:42:30.371Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AVZ8T8QHTC4CSC1C1DJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.338" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1973gitlab # [ 337.520647] gitlab-workhorse[821]: time="2026-09-06T15:42:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091974gitlab # [ 337.524734] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1011975gitlab # [ 337.528876] gitaly[894]: time="2026-09-06T15:42:30.378Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5AVZ8T8QHTC4CSC1C1DJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:30.338" grpc.time_ms=33.797 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1976gitlab # [ 337.616508] gitaly[894]: time="2026-09-06T15:42:30.533Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:43:00.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:30.532" grpc.time_ms=1.062 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 337.692600] gitaly[894]: time="2026-09-06T15:42:30.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T15:43:00.092" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:30.592" grpc.time_ms=16.336 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 337.759078] gitaly[894]: time="2026-09-06T15:42:30.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:42:40.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:30.661" grpc.time_ms=14.243 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 337.800372] gitaly[894]: time="2026-09-06T15:42:30.710Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:42:40.222" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:30.693" grpc.time_ms=16.532 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 338.072218] gitaly[894]: time="2026-09-06T15:42:30.988Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:42:40.177" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:30.987" grpc.time_ms=0.666 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 338.106469] gitaly[894]: time="2026-09-06T15:42:31.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T15:42:41.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:31.007" grpc.time_ms=15.242 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'1983gitlab # [ 338.181079] gitaly[894]: time="2026-09-06T15:42:31.097Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:31.096" grpc.time_ms=0.868 pid=894 span.kind=server system=grpc1984gitlab # [ 338.268799] nixbot[3536]: INFO: ::ffff:127.0.0.1:41378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.08 seconds)1986gitlab # [ 338.277381] gitaly[894]: time="2026-09-06T15:42:31.184Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:42:31.182" grpc.time_ms=1.947 pid=894 span.kind=server system=grpc1987gitlab # [ 338.301306] gitaly[894]: time="2026-09-06T15:42:31.209Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM diskcache=6002790d-4b13-4ebd-830e-973dcc36c9e7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:42:41.027" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:31.028" pid=894 ref=refs/keep-around/f3cef85b4ae9331176aa86936276de5385bc89d9 remote_ip="2001:db8:1::1" revision=f3cef85b4ae9331176aa86936276de5385bc89d9 span.kind=server system=grpc username=root1988gitlab # [ 338.325496] gitaly[894]: time="2026-09-06T15:42:31.210Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=145 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5461 command.oublock=8 command.real_time_ms=166 command.spawn_token_fork_ms=2 command.system_time_ms=82 command.user_time_ms=63 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:42:41.027" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:42:31.028" grpc.time_ms=181.873 pid=894 ref=refs/keep-around/f3cef85b4ae9331176aa86936276de5385bc89d9 remote_ip="2001:db8:1::1" revision=f3cef85b4ae9331176aa86936276de5385bc89d9 span.kind=server system=grpc username=root1989gitlab # [ 338.350910] gitaly[894]: time="2026-09-06T15:42:31.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:43:01.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:31.216" grpc.time_ms=0.789 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 338.590080] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 10621991gitlab # [ 338.593821] nixbot[3536]: {"ts": "2026-09-06T15:42:31.508Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}1992gitlab # [ 338.610814] nixbot[3536]: {"ts": "2026-09-06T15:42:31.527Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f3cef85b4ae9-0"}1993gitlab # [ 338.915879] nixbot[3536]: {"ts": "2026-09-06T15:42:31.832Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f3cef85b4ae9-0", "argv0": "bwrap"}1994gitlab # [ 339.094051] systemd[1]: Started Nix Daemon.1995gitlab # [ 339.217895] nix-daemon[3767]: accepted connection from pid 3762, user nixbot1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)1998gitlab # [ 339.338402] nixbot[3536]: INFO: ::ffff:127.0.0.1:41386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2000gitlab # [ 340.393852] nixbot[3536]: INFO: ::ffff:127.0.0.1:41392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2003gitlab # [ 341.451251] nixbot[3536]: INFO: ::ffff:127.0.0.1:53790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2007gitlab # [ 342.510052] nixbot[3536]: INFO: ::ffff:127.0.0.1:53794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2009gitlab # [ 343.563914] nixbot[3536]: INFO: ::ffff:127.0.0.1:53808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2011gitlab # [ 344.269187] nix-daemon[3767]: accepted connection from pid 3797, user nixbot2012gitlab # [ 344.293200] nix-daemon[3767]: accepted connection from pid 3762, user nixbot2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2015gitlab # [ 344.619712] nixbot[3536]: INFO: ::ffff:127.0.0.1:53814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2018gitlab # [ 345.676753] nixbot[3536]: INFO: ::ffff:127.0.0.1:53824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2020gitlab # [ 346.731405] nixbot[3536]: INFO: ::ffff:127.0.0.1:53840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2024gitlab # [ 347.788126] nixbot[3536]: INFO: ::ffff:127.0.0.1:53850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2027gitlab # [ 348.842278] nixbot[3536]: INFO: ::ffff:127.0.0.1:53856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2028gitlab # [ 349.163774] nix-daemon[3767]: accepted connection from pid 3762, user nixbot2029gitlab # [ 349.353559] gitaly[894]: time="2026-09-06T15:42:42.269Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5PEZP72P2R6CSRBMCVEA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:43:12.158" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:42.259" grpc.time_ms=9.76 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 349.598654] gitaly[894]: time="2026-09-06T15:42:42.515Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5PEZP72P2R6CSRBMCVEA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:42:52.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:42.496" grpc.time_ms=18.364 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 349.798003] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 676 "" "python-httpx/0.28.1" 5692032gitlab # [ 349.806043] nixbot[3536]: {"ts": "2026-09-06T15:42:42.716Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2034gitlab # [ 349.897355] nixbot[3536]: INFO: ::ffff:127.0.0.1:53864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2036gitlab # [ 349.905551] gitaly[894]: time="2026-09-06T15:42:42.822Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5Q15WA66P53NDZ57WAAP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:43:12.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:42.820" grpc.time_ms=1.307 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 349.966403] gitaly[894]: time="2026-09-06T15:42:42.883Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5Q15WA66P53NDZ57WAAP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:42:52.173" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:42.864" grpc.time_ms=18.337 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 350.063198] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2532039gitlab # [ 350.069484] nixbot[3536]: {"ts": "2026-09-06T15:42:42.981Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2040gitlab # [ 350.204169] gitaly[894]: time="2026-09-06T15:42:43.120Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5Q9VP90SRAT3QQB9XJ43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:43:13.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:42:43.119" grpc.time_ms=1.308 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 350.278013] gitaly[894]: time="2026-09-06T15:42:43.194Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5Q9VP90SRAT3QQB9XJ43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:42:53.173" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:42:43.174" grpc.time_ms=20.134 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 350.374791] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2872043gitlab # [ 350.379213] nixbot[3536]: {"ts": "2026-09-06T15:42:43.293Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2046gitlab # [ 350.947949] nixbot[3536]: INFO: ::ffff:127.0.0.1:50964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2047gitlab # [ 351.034818] gitaly[894]: time="2026-09-06T15:42:43.950Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5R3EP5WA1RNH73WCY6DE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:43.930" grpc.time_ms=20.074 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2048gitlab # [ 351.075472] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1682049gitlab # [ 351.206737] gitaly[894]: time="2026-09-06T15:42:44.123Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5R8T4XDP2DWKC9CF4KFV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.106" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2050gitlab # [ 351.228320] gitaly[894]: time="2026-09-06T15:42:44.123Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5R8T4XDP2DWKC9CF4KFV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.106" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2051gitlab # [ 351.253970] gitlab-workhorse[821]: time="2026-09-06T15:42:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672052gitlab # [ 351.257275] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1302053gitlab # [ 351.264308] gitaly[894]: time="2026-09-06T15:42:44.126Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5R8T4XDP2DWKC9CF4KFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.106" grpc.time_ms=17.274 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2054gitlab # [ 351.424600] gitaly[894]: time="2026-09-06T15:42:44.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5RFZ4EKEVFS3S3EE2QEC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.328" grpc.time_ms=12.273 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2055gitlab # [ 351.459124] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1182056gitlab # [ 351.562270] gitaly[894]: time="2026-09-06T15:42:44.478Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RKR9P87QVPRHNRKWMHN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.458" pid=894 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2057gitlab # [ 351.594700] gitaly[894]: time="2026-09-06T15:42:44.479Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RKR9P87QVPRHNRKWMHN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.458" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2058gitlab # [ 351.634394] gitlab-workhorse[821]: time="2026-09-06T15:42:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672059gitlab # [ 351.639225] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1462060gitlab # [ 351.643787] gitaly[894]: time="2026-09-06T15:42:44.479Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RKR9P87QVPRHNRKWMHN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.458" grpc.time_ms=20.791 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2061gitlab # [ 351.789530] gitaly[894]: time="2026-09-06T15:42:44.706Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5RVGVCK5XP2Z3GCWMR2W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.688" grpc.time_ms=17.026 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2062gitlab # [ 351.828845] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:44 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1142063gitlab # [ 351.915840] gitaly[894]: time="2026-09-06T15:42:44.832Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RZ7QETX362H697QWW7S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.797" pid=894 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2065gitlab # [ 351.947887] gitaly[894]: time="2026-09-06T15:42:44.832Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RZ7QETX362H697QWW7S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.797" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2066gitlab # [ 351.987005] gitlab-workhorse[821]: time="2026-09-06T15:42:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162067gitlab # [ 351.991219] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:42:44 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1222068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2069gitlab # [ 351.995260] gitaly[894]: time="2026-09-06T15:42:44.833Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5RZ7QETX362H697QWW7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:42:44.797" grpc.time_ms=35.739 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2070gitlab # [ 352.021131] nixbot[3536]: INFO: ::ffff:127.0.0.1:50978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2072gitlab # [ 353.060136] nixbot[3536]: INFO: ::ffff:127.0.0.1:50980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2076gitlab # [ 354.116148] nixbot[3536]: INFO: ::ffff:127.0.0.1:50986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2077gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2078gitlab # [ 355.170130] nixbot[3536]: INFO: ::ffff:127.0.0.1:50994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2081gitlab # [ 356.227293] nixbot[3536]: INFO: ::ffff:127.0.0.1:51010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2082gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2084gitlab # [ 357.284338] nixbot[3536]: INFO: ::ffff:127.0.0.1:51012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2085gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2086gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2088gitlab # [ 358.344209] nixbot[3536]: INFO: ::ffff:127.0.0.1:51014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2089gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2090gitlab # [ 359.400145] nixbot[3536]: INFO: ::ffff:127.0.0.1:51026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2091gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2093gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2094gitlab # [ 360.456197] nixbot[3536]: INFO: ::ffff:127.0.0.1:51032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2095gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2096gitlab # [ 361.511550] nixbot[3536]: INFO: ::ffff:127.0.0.1:46952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2098gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2100gitlab # [ 362.568210] nixbot[3536]: INFO: ::ffff:127.0.0.1:46966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2101gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2103gitlab # [ 363.622527] nixbot[3536]: INFO: ::ffff:127.0.0.1:46970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2106gitlab # [ 364.677230] nixbot[3536]: INFO: ::ffff:127.0.0.1:46978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2107gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2108gitlab # [ 365.732165] nixbot[3536]: INFO: ::ffff:127.0.0.1:46988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2109gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2110gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2111gitlab # [ 366.789218] nixbot[3536]: INFO: ::ffff:127.0.0.1:46998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2112gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2114gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2115gitlab # [ 367.847736] nixbot[3536]: INFO: ::ffff:127.0.0.1:47004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2116gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2118gitlab # [ 368.903109] nixbot[3536]: INFO: ::ffff:127.0.0.1:47016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.04 seconds)2121gitlab # [ 369.941798] nixbot[3536]: INFO: ::ffff:127.0.0.1:47030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2122gitlab # [ 370.636536] sidekiq-cluster[3428]: 2026-09-06T15:43:03.551Z pid=3428 tid=yq4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3428, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430628864}2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2125gitlab # [ 370.990992] nixbot[3536]: INFO: ::ffff:127.0.0.1:44212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2126gitlab # [ 371.090976] sidekiq-cluster[3428]: W, [2026-09-06T15:43:04.007561 #3428] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2127gitlab # [ 371.190504] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:04.107Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2128gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2129gitlab # [ 372.049021] nixbot[3536]: INFO: ::ffff:127.0.0.1:44226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2133gitlab # [ 373.106216] nixbot[3536]: INFO: ::ffff:127.0.0.1:44238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2134gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2136gitlab # [ 374.164574] nixbot[3536]: INFO: ::ffff:127.0.0.1:44242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2137gitlab # [ 374.762099] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:07.677Z","message":"GitLab reliable fetch activated!"}2138gitlab # [ 374.762521] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:07.677Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2140gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2141gitlab # [ 375.220209] nixbot[3536]: INFO: ::ffff:127.0.0.1:44250 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2144gitlab # [ 376.276368] nixbot[3536]: INFO: ::ffff:127.0.0.1:44264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2145gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2146gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2147gitlab # [ 377.332256] nixbot[3536]: INFO: ::ffff:127.0.0.1:44280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2148gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2149gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2150gitlab # [ 378.386997] nixbot[3536]: INFO: ::ffff:127.0.0.1:44292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2151gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2152gitlab # [ 379.442136] nixbot[3536]: INFO: ::ffff:127.0.0.1:44296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2153gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2154gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2156gitlab # [ 380.500703] nixbot[3536]: INFO: ::ffff:127.0.0.1:44298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2158gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2159gitlab # [ 381.556451] nixbot[3536]: INFO: ::ffff:127.0.0.1:35846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2160gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2161gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2162gitlab # [ 382.612521] nixbot[3536]: INFO: ::ffff:127.0.0.1:35862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2163gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2164gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2165gitlab # [ 383.667796] nixbot[3536]: INFO: ::ffff:127.0.0.1:35868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2166gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2167gitlab # [ 384.723336] nixbot[3536]: INFO: ::ffff:127.0.0.1:35882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2171gitlab # [ 385.779390] nixbot[3536]: INFO: ::ffff:127.0.0.1:35898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2172gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2173gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2174gitlab # [ 386.835183] nixbot[3536]: INFO: ::ffff:127.0.0.1:35908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2175gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2176gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2177gitlab # [ 387.889391] nixbot[3536]: INFO: ::ffff:127.0.0.1:35920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2178gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2179gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.04 seconds)2180gitlab # [ 388.930369] nixbot[3536]: INFO: ::ffff:127.0.0.1:35932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2181gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2182gitlab # [ 389.986029] nixbot[3536]: INFO: ::ffff:127.0.0.1:35938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2183gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2184gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2185gitlab # [ 391.043652] nixbot[3536]: INFO: ::ffff:127.0.0.1:39022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2186gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2187gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2189gitlab # [ 392.102051] nixbot[3536]: INFO: ::ffff:127.0.0.1:39030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2190gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2191gitlab # [ 393.158955] nixbot[3536]: INFO: ::ffff:127.0.0.1:39032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2192gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2193gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2194gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2195gitlab # [ 394.217222] nixbot[3536]: INFO: ::ffff:127.0.0.1:39036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2196gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2197gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2198gitlab # [ 395.273012] nixbot[3536]: INFO: ::ffff:127.0.0.1:39052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2199gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2200gitlab # [ 396.327752] nixbot[3536]: INFO: ::ffff:127.0.0.1:39068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2201gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2202gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2203gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2204gitlab # [ 397.386355] nixbot[3536]: INFO: ::ffff:127.0.0.1:39084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2205gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2206gitlab # [ 398.423699] nixbot[3536]: INFO: ::ffff:127.0.0.1:39086 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2207gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.04 seconds)2208gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2209gitlab # [ 399.480171] nixbot[3536]: INFO: ::ffff:127.0.0.1:39090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2210gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2211gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2212gitlab # [ 400.537018] nixbot[3536]: INFO: ::ffff:127.0.0.1:39106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2213gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2214gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2215gitlab # [ 401.594214] nixbot[3536]: INFO: ::ffff:127.0.0.1:42938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2216gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2217gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2218gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2219gitlab # [ 402.652049] nixbot[3536]: INFO: ::ffff:127.0.0.1:42954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2220gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2221gitlab # [ 403.707383] nixbot[3536]: INFO: ::ffff:127.0.0.1:42958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2222gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2223gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2224gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2225gitlab # [ 404.765808] nixbot[3536]: INFO: ::ffff:127.0.0.1:42974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2226gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2227gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2228gitlab # [ 405.820582] nixbot[3536]: INFO: ::ffff:127.0.0.1:42978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2229gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2230gitlab # [ 406.883644] nixbot[3536]: INFO: ::ffff:127.0.0.1:42992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.07 seconds)2232gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2233gitlab # [ 407.942652] nixbot[3536]: INFO: ::ffff:127.0.0.1:42998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2234gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2236gitlab # [ 409.005882] nixbot[3536]: INFO: ::ffff:127.0.0.1:43010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2237gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2238gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2239gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2240gitlab # [ 410.061321] nixbot[3536]: INFO: ::ffff:127.0.0.1:43018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2241gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2242gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2243gitlab # [ 411.115040] nixbot[3536]: INFO: ::ffff:127.0.0.1:51594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2244gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2245gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2246gitlab # [ 412.168641] nixbot[3536]: INFO: ::ffff:127.0.0.1:51600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2247gitlab # [ 412.986447] postgres[4121]: [4121] ERROR: relation "table_without_models" does not exist2248gitlab # [ 412.986804] postgres[4121]: [4121] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2249gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2250gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2251gitlab # [ 413.223298] nixbot[3536]: INFO: ::ffff:127.0.0.1:51616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2252gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2253gitlab # [ 414.278278] nixbot[3536]: INFO: ::ffff:127.0.0.1:51620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2254gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2255gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2256gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2257gitlab # [ 415.333744] nixbot[3536]: INFO: ::ffff:127.0.0.1:51634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2258gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2259gitlab # [ 416.387744] nixbot[3536]: INFO: ::ffff:127.0.0.1:51642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2260gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2261gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2262gitlab # [ 417.443694] nixbot[3536]: INFO: ::ffff:127.0.0.1:51650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2263gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2264gitlab # [ 417.870962] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:50.786Z","message":"Booted Rails 7.2.3.1 application in production environment"}2265gitlab # [ 417.873116] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:50.787Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2266gitlab # [ 417.875067] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:50.787Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2267gitlab # [ 417.876868] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:50.787Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2268gitlab # [ 417.878868] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:50.790Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2269gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2270gitlab # [ 418.503130] nixbot[3536]: INFO: ::ffff:127.0.0.1:51654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2271gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2272gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2273gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2274gitlab # [ 419.560478] nixbot[3536]: INFO: ::ffff:127.0.0.1:51660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2275gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2276gitlab # [ 420.553290] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:53.468Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7b8f92303fad90321d271ba0","created_at":"2026-09-06T15:42:18.626Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:18.680Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7b8f92303fad90321d271ba0: start","job_status":"start","queue_duration_s":94.787726,"scheduling_latency_s":94.787832}2277gitlab # [ 420.646970] nixbot[3536]: INFO: ::ffff:127.0.0.1:51668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2278gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.09 seconds)2279gitlab # [ 420.808221] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:53.723Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7b8f92303fad90321d271ba0","created_at":"2026-09-06T15:42:18.626Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:18.680Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7b8f92303fad90321d271ba0: done: 0.256139 sec","job_status":"done","queue_duration_s":94.787726,"scheduling_latency_s":94.787832,"redis_calls":23,"redis_duration_s":0.009252,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005141,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002389,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1327773,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.256139,"completed_at":"2026-09-06T15:43:53.723Z","load_balancing_strategy":"primary","db_duration_s":0.077155,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2280gitlab # [ 420.920408] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:53.727Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8e3450b9eaa4ad22db39160d","created_at":"2026-09-06T15:42:18.697Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:18.705Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8e3450b9eaa4ad22db39160d: start","job_status":"start","queue_duration_s":95.021809,"scheduling_latency_s":95.021855}2281gitlab # [ 420.998180] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:53.914Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8e3450b9eaa4ad22db39160d","created_at":"2026-09-06T15:42:18.697Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:18.705Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8e3450b9eaa4ad22db39160d: done: 0.186986 sec","job_status":"done","queue_duration_s":95.021809,"scheduling_latency_s":95.021855,"redis_calls":14,"redis_duration_s":0.005213,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001087,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002545,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14176532,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.186986,"completed_at":"2026-09-06T15:43:53.914Z","load_balancing_strategy":"primary","db_duration_s":0.03724,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2282gitlab # [ 421.100322] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:53.916Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6fb3d47c90205cdf9d01125b","created_at":"2026-09-06T15:42:19.738Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.748Z","job_size_bytes":5,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6fb3d47c90205cdf9d01125b: start","job_status":"start","queue_duration_s":94.168512,"scheduling_latency_s":94.168541}2283gitlab # [ 421.281772] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.197Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6fb3d47c90205cdf9d01125b","created_at":"2026-09-06T15:42:19.738Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.748Z","job_size_bytes":5,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6fb3d47c90205cdf9d01125b: done: 0.281105 sec","job_status":"done","queue_duration_s":94.168512,"scheduling_latency_s":94.168541,"redis_calls":12,"redis_duration_s":0.004384,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001488,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002328,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.229672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003823,"duration_s":0.281105,"completed_at":"2026-09-06T15:43:54.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044645,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2284gitlab # [ 421.381215] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.199Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"bb29119ff229ac9def07999c","created_at":"2026-09-06T15:42:19.786Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.793Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-bb29119ff229ac9def07999c: start","job_status":"start","queue_duration_s":94.406184,"scheduling_latency_s":94.406209}2285gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2286gitlab # [ 421.659001] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.573Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"bb29119ff229ac9def07999c","created_at":"2026-09-06T15:42:19.786Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.793Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-bb29119ff229ac9def07999c: done: 0.373895 sec","job_status":"done","queue_duration_s":94.406184,"scheduling_latency_s":94.406209,"redis_calls":11,"redis_duration_s":0.003517,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000772,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00068,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.324,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.324,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.261697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072848,"duration_s":0.373895,"completed_at":"2026-09-06T15:43:54.573Z","load_balancing_strategy":"primary","db_duration_s":0.120728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2287gitlab # [ 421.758927] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.576Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"253cbeb4b339e40ac3d2a6fb","created_at":"2026-09-06T15:42:19.798Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.804Z","job_size_bytes":89,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-253cbeb4b339e40ac3d2a6fb: start","job_status":"start","queue_duration_s":94.772089,"scheduling_latency_s":94.77212}2288gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.15 seconds)2289gitlab # [ 421.780207] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.635Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"253cbeb4b339e40ac3d2a6fb","created_at":"2026-09-06T15:42:19.798Z","trace_propagation_headers":{"sentry-trace":"60d17b13475d4887b35a988e46cebbf6-b35f72ebde1b432e","baggage":"sentry-trace_id=60d17b13475d4887b35a988e46cebbf6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP4XVVTRY18SXK2AKRDY6R","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:19.804Z","job_size_bytes":89,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-253cbeb4b339e40ac3d2a6fb: done: 0.059238 sec","job_status":"done","queue_duration_s":94.772089,"scheduling_latency_s":94.77212,"redis_calls":11,"redis_duration_s":0.0036100000000000004,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000898,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060438,"duration_s":0.059238,"completed_at":"2026-09-06T15:43:54.635Z","load_balancing_strategy":"primary","db_duration_s":0.00893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 421.831936] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.638Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f3cef85b4ae9331176aa86936276de5385bc89d9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f426bfb00139b16166928476","created_at":"2026-09-06T15:42:24.279Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-9d6196fbdfa844a5","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:24.325Z","job_size_bytes":185,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f426bfb00139b16166928476: start","job_status":"start","queue_duration_s":90.312924,"scheduling_latency_s":90.312953}2291gitlab # [ 421.850275] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:54.662Z","message":"changes: \"0000000000000000000000000000000000000000 f3cef85b4ae9331176aa86936276de5385bc89d9 refs/heads/master\\n\""}2292gitlab # [ 421.853148] gitaly[894]: time="2026-09-06T15:43:54.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:04.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:54.698" grpc.time_ms=18.295 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 421.866592] nixbot[3536]: INFO: ::ffff:127.0.0.1:45044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2294gitlab # [ 421.868553] gitaly[894]: time="2026-09-06T15:43:54.742Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:44:04.032" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:54.724" grpc.time_ms=17.848 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 421.898583] gitaly[894]: time="2026-09-06T15:43:54.815Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T15:44:04.112" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:54.802" grpc.time_ms=12.886 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 421.976547] gitaly[894]: time="2026-09-06T15:43:54.893Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:43:54.891" grpc.time_ms=1.786 pid=894 span.kind=server system=grpc2297gitlab # [ 422.029151] gitaly[894]: time="2026-09-06T15:43:54.945Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:43:54.944" grpc.time_ms=0.867 pid=894 span.kind=server system=grpc2298gitlab # [ 422.053435] gitaly[894]: time="2026-09-06T15:43:54.962Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM diskcache=8509c346-0748-415b-83a3-c4950703bd04 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:44:04.145" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:54.836" pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2299gitlab # [ 422.074305] gitaly[894]: time="2026-09-06T15:43:54.963Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5139 command.oublock=8 command.real_time_ms=121 command.spawn_token_fork_ms=0 command.system_time_ms=75 command.user_time_ms=56 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:44:04.145" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:54.836" grpc.time_ms=126.849 pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2300gitlab # [ 422.095162] gitaly[894]: time="2026-09-06T15:43:54.992Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T15:44:04.011" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:54.991" grpc.time_ms=0.325 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 422.111113] gitaly[894]: time="2026-09-06T15:43:55.025Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T15:44:04.018" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:54.999" grpc.time_ms=26.199 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 422.305185] gitaly[894]: time="2026-09-06T15:43:55.221Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-06T15:44:25.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:55.208" grpc.time_ms=12.683 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2303gitlab # [ 422.366048] gitaly[894]: time="2026-09-06T15:43:55.282Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:44:05.011" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:55.281" grpc.time_ms=0.606 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2304gitlab # [ 422.389813] gitaly[894]: time="2026-09-06T15:43:55.300Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T15:44:05.017" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T15:43:55.288" grpc.time_ms=12.005 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 422.431786] gitaly[894]: time="2026-09-06T15:43:55.348Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:05.059" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:55.330" grpc.time_ms=17.873 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 422.466904] gitaly[894]: time="2026-09-06T15:43:55.375Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:05.086" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:55.357" grpc.time_ms=17.785 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2307gitlab # [ 422.510290] gitaly[894]: time="2026-09-06T15:43:55.426Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T15:44:25.198" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:55.398" grpc.time_ms=28.005 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2309gitlab # [ 422.870705] nixbot[3536]: INFO: ::ffff:127.0.0.1:45056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2310gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.07 seconds)2311gitlab # [ 423.119607] gitaly[894]: time="2026-09-06T15:43:56.035Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T15:44:06.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:56.033" grpc.time_ms=2.256 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 423.188713] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.103Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f3cef85b4ae9331176aa86936276de5385bc89d9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f426bfb00139b16166928476","created_at":"2026-09-06T15:42:24.279Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-9d6196fbdfa844a5","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:24.325Z","job_size_bytes":185,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f426bfb00139b16166928476: done: 1.465418 sec","job_status":"done","queue_duration_s":90.312924,"scheduling_latency_s":90.312953,"gitaly_calls":13,"gitaly_duration_s":0.353152,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064933,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.007863,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008449,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002125,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004387,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025081,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.017028,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.329,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.382,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.093,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.960209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075538,"exclusive_lock_hold_duration_s":0.040788200000000004,"duration_s":1.465418,"completed_at":"2026-09-06T15:43:56.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.161113,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2313gitlab # [ 423.301249] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.105Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f3cef85b4ae9331176aa86936276de5385bc89d9 631e5202beb049dde21ed2d10f9e5159f2411c94 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0b9f9c992dc7b0db5416a451","created_at":"2026-09-06T15:42:29.925Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-9c12d9fa502b4621","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:29.930Z","job_size_bytes":185,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0b9f9c992dc7b0db5416a451: start","job_status":"start","queue_duration_s":86.175503,"scheduling_latency_s":86.175534}2314gitlab # [ 423.332753] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.123Z","message":"changes: \"f3cef85b4ae9331176aa86936276de5385bc89d9 631e5202beb049dde21ed2d10f9e5159f2411c94 refs/heads/master\\n\""}2315gitlab # [ 423.336657] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.201Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"34706222362a7f54be327934","created_at":"2026-09-06T15:43:56.198Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"0ad806017411659062c5c2f9","job_size_bytes":46,"pid":3428,"job_status":"deduplicated","message":"ProjectCacheWorker JID-34706222362a7f54be327934: deduplicated: until executing","deduplication.type":"until executing"}2316gitlab # [ 423.359777] gitaly[894]: time="2026-09-06T15:43:56.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:06.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:56.148" grpc.time_ms=18.574 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 423.376988] gitaly[894]: time="2026-09-06T15:43:56.193Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T15:44:06.145" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:56.176" grpc.time_ms=17.269 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 423.392044] gitaly[894]: time="2026-09-06T15:43:56.245Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T15:44:06.196" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:56.226" grpc.time_ms=18.576 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 423.405507] gitaly[894]: time="2026-09-06T15:43:56.274Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-06T15:44:26.054" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:56.254" grpc.time_ms=19.846 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 423.420659] gitaly[894]: time="2026-09-06T15:43:56.307Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=320 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T15:44:06.025" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T15:43:56.295" grpc.time_ms=11.079 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 423.433787] gitaly[894]: time="2026-09-06T15:43:56.340Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:06.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:56.323" grpc.time_ms=16.926 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2322gitlab # [ 423.734956] gitaly[894]: time="2026-09-06T15:43:56.651Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T15:44:06.238" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:56.508" grpc.time_ms=142.856 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 423.775315] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.675Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f3cef85b4ae9331176aa86936276de5385bc89d9 631e5202beb049dde21ed2d10f9e5159f2411c94 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0b9f9c992dc7b0db5416a451","created_at":"2026-09-06T15:42:29.925Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-9c12d9fa502b4621","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:42:29.930Z","job_size_bytes":185,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0b9f9c992dc7b0db5416a451: done: 0.569378 sec","job_status":"done","queue_duration_s":86.175503,"scheduling_latency_s":86.175534,"gitaly_calls":7,"gitaly_duration_s":0.272663,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032859,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.003407,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001578,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006061,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010858,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.010955,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.041,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.041,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.398148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0011717,"exclusive_lock_hold_duration_s":0.032899,"duration_s":0.569378,"completed_at":"2026-09-06T15:43:56.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040388,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2324gitlab # [ 423.858007] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.677Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3703fe6f09b5fcacfbcd3990","created_at":"2026-09-06T15:42:31.226Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.238Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3703fe6f09b5fcacfbcd3990: start","job_status":"start","queue_duration_s":85.438711,"scheduling_latency_s":85.438736}2325gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2326gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2327gitlab # [ 423.899037] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.814Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3703fe6f09b5fcacfbcd3990","created_at":"2026-09-06T15:42:31.226Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.238Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3703fe6f09b5fcacfbcd3990: done: 0.137249 sec","job_status":"done","queue_duration_s":85.438711,"scheduling_latency_s":85.438736,"redis_calls":16,"redis_duration_s":0.006161,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002952,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002464,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00116398,"duration_s":0.137249,"completed_at":"2026-09-06T15:43:56.814Z","load_balancing_strategy":"primary","db_duration_s":0.038804,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2328gitlab # [ 423.975045] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:56.819Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"61f5b2337e30638cb015c05b","created_at":"2026-09-06T15:42:31.239Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.249Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-61f5b2337e30638cb015c05b: start","job_status":"start","queue_duration_s":85.569794,"scheduling_latency_s":85.56985}2329gitlab # [ 423.997077] nixbot[3536]: INFO: ::ffff:127.0.0.1:45066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2330gitlab # [ 424.111614] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.027Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"61f5b2337e30638cb015c05b","created_at":"2026-09-06T15:42:31.239Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.249Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-61f5b2337e30638cb015c05b: done: 0.207823 sec","job_status":"done","queue_duration_s":85.569794,"scheduling_latency_s":85.56985,"redis_calls":21,"redis_duration_s":0.012645,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.006952,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002564,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073268,"duration_s":0.207823,"completed_at":"2026-09-06T15:43:57.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 424.217508] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.029Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5bf791e5598e8b3ec3b74b02","created_at":"2026-09-06T15:42:31.470Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.480Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5bf791e5598e8b3ec3b74b02: start","job_status":"start","queue_duration_s":85.549922,"scheduling_latency_s":85.549953}2332gitlab # [ 424.389301] gitaly[894]: time="2026-09-06T15:43:57.304Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:43:57.303" grpc.time_ms=0.866 pid=894 span.kind=server system=grpc2333gitlab # [ 424.443893] gitaly[894]: time="2026-09-06T15:43:57.360Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:43:57.359" grpc.time_ms=0.821 pid=894 span.kind=server system=grpc2334gitlab # [ 424.498791] gitaly[894]: time="2026-09-06T15:43:57.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:43:57.414" grpc.time_ms=0.86 pid=894 span.kind=server system=grpc2335gitlab # [ 424.528127] gitaly[894]: time="2026-09-06T15:43:57.432Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM diskcache=d787e062-1a8a-4d30-acb7-1fdc10c8b7a9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:27.043" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:57.244" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 424.550432] gitaly[894]: time="2026-09-06T15:43:57.433Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=208 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7564 command.oublock=0 command.real_time_ms=181 command.spawn_token_fork_ms=1 command.system_time_ms=132 command.user_time_ms=76 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:27.043" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:57.244" grpc.time_ms=188.218 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 424.751470] gitaly[894]: time="2026-09-06T15:43:57.668Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:27.465" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:57.666" grpc.time_ms=1.747 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 424.837153] gitaly[894]: time="2026-09-06T15:43:57.753Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP5B1BQ1DPVPKDHRKSE7ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:27.550" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:57.751" grpc.time_ms=1.311 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2339gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2340gitlab # [ 424.877676] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.793Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5bf791e5598e8b3ec3b74b02","created_at":"2026-09-06T15:42:31.470Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-a3e2d933b0774351","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:42:31.480Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5bf791e5598e8b3ec3b74b02: done: 0.763556 sec","job_status":"done","queue_duration_s":85.549922,"scheduling_latency_s":85.549953,"gitaly_calls":3,"gitaly_duration_s":0.203498,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042601,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001832,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002415,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014866,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.00632,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010562,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000856,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000791,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003127,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.036,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.435481,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6593207000000001,"duration_s":0.763556,"completed_at":"2026-09-06T15:43:57.793Z","load_balancing_strategy":"primary","db_duration_s":0.115307,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2341gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.05 seconds)2342gitlab # [ 424.974540] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.796Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ad806017411659062c5c2f9","created_at":"2026-09-06T15:43:54.744Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.765Z","job_size_bytes":46,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ad806017411659062c5c2f9: start","job_status":"start","queue_duration_s":3.030128,"scheduling_latency_s":3.030162}2343gitlab # [ 424.995658] gitaly[894]: time="2026-09-06T15:43:57.889Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-06T21:43:57.875" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:43:57.876" grpc.time_ms=12.498 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 425.010095] nixbot[3536]: INFO: ::ffff:127.0.0.1:45076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2345gitlab # [ 425.012471] gitaly[894]: time="2026-09-06T15:43:57.926Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T15:44:27.707" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:57.908" grpc.time_ms=18.398 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab # [ 425.067416] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.983Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ad806017411659062c5c2f9","created_at":"2026-09-06T15:43:54.744Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.765Z","job_size_bytes":46,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ad806017411659062c5c2f9: done: 0.187109 sec","job_status":"done","queue_duration_s":3.030128,"scheduling_latency_s":3.030162,"gitaly_calls":2,"gitaly_duration_s":0.041564,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.01443,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002426,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001135,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002569,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.007226,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056064,"duration_s":0.187109,"completed_at":"2026-09-06T15:43:57.983Z","load_balancing_strategy":"primary","db_duration_s":0.01801,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2347gitlab # [ 425.135307] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:57.986Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5eb521ddf37ca2b0424d4a56","created_at":"2026-09-06T15:43:54.789Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.796Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5eb521ddf37ca2b0424d4a56: start","job_status":"start","queue_duration_s":3.189395,"scheduling_latency_s":3.189427}2348gitlab # [ 425.153721] gitaly[894]: time="2026-09-06T15:43:58.063Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM diskcache=f20c172d-a837-4c84-a50e-4d8c658b038c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T21:43:58.022" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.023" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 425.164165] gitaly[894]: time="2026-09-06T15:43:58.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T21:43:58.022" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.023" grpc.time_ms=40.833 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 425.221717] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:58.137Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5eb521ddf37ca2b0424d4a56","created_at":"2026-09-06T15:43:54.789Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.796Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5eb521ddf37ca2b0424d4a56: done: 0.150957 sec","job_status":"done","queue_duration_s":3.189395,"scheduling_latency_s":3.189427,"gitaly_calls":1,"gitaly_duration_s":0.044683,"redis_calls":15,"redis_duration_s":0.005686,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001017,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000837,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11044916,"duration_s":0.150957,"completed_at":"2026-09-06T15:43:58.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2351gitlab # [ 425.280998] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:58.139Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0e9a32b482723b56fd74fcbe","created_at":"2026-09-06T15:43:54.982Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.986Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0e9a32b482723b56fd74fcbe: start","job_status":"start","queue_duration_s":3.153143,"scheduling_latency_s":3.153174}2352gitlab # [ 425.296598] gitaly[894]: time="2026-09-06T15:43:58.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T15:44:28.081" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.182" grpc.time_ms=17.034 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2353gitlab # [ 425.309451] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:58.220Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0e9a32b482723b56fd74fcbe","created_at":"2026-09-06T15:43:54.982Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:54.986Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0e9a32b482723b56fd74fcbe: done: 0.080916 sec","job_status":"done","queue_duration_s":3.153143,"scheduling_latency_s":3.153174,"gitaly_calls":1,"gitaly_duration_s":0.020512,"redis_calls":16,"redis_duration_s":0.006111,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000553,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002809,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080916,"completed_at":"2026-09-06T15:43:58.220Z","load_balancing_strategy":"primary","db_duration_s":0.004868,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2354gitlab # [ 425.354386] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:58.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5ecf80f65142b6c4b9cd4a80","created_at":"2026-09-06T15:43:55.834Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ba4fb564978e65f5a784cb573dbac91cb0bdcf7df14e6371a6eaf243ae314f08","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:55.841Z","job_size_bytes":467,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5ecf80f65142b6c4b9cd4a80: start","job_status":"start","queue_duration_s":2.38239,"scheduling_latency_s":2.382433}2355gitlab # [ 425.371200] gitaly[894]: time="2026-09-06T15:43:58.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:28.181" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.281" grpc.time_ms=1.13 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 425.390136] gitaly[894]: time="2026-09-06T15:43:58.305Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T15:44:08.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:58.288" grpc.time_ms=17.465 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 425.576924] gitaly[894]: time="2026-09-06T15:43:58.493Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:28.391" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.491" grpc.time_ms=1.41 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 425.616561] gitaly[894]: time="2026-09-06T15:43:58.506Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=173 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T15:44:28.401" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:58.501" grpc.time_ms=3.847 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 425.770204] gitaly[894]: time="2026-09-06T15:43:58.686Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:08.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:58.669" grpc.time_ms=16.855 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2360gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2361gitlab # [ 426.050615] nixbot[3536]: INFO: ::ffff:127.0.0.1:45084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2362gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.07 seconds)2363gitlab # [ 426.414434] gitaly[894]: time="2026-09-06T15:43:59.329Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T15:44:29.201" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.301" grpc.time_ms=27.789 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2364gitlab # [ 426.458055] gitaly[894]: time="2026-09-06T15:43:59.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP53DZFXX6D2AM7E6AH6PM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T15:44:29.235" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.335" grpc.time_ms=22.332 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2365gitlab # [ 426.508237] sidekiq-cluster[3428]: {"severity":"WARN","time":"2026-09-06T15:43:59.423Z","class":"CreatePipelineWorker","correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f3cef85b4ae9331176aa86936276de5385bc89d9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f3cef85b4ae9331176aa86936276de5385bc89d9","ref":"refs/heads/master"},"retry":0}2366gitlab # [ 426.529673] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5ecf80f65142b6c4b9cd4a80","created_at":"2026-09-06T15:43:55.834Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ba4fb564978e65f5a784cb573dbac91cb0bdcf7df14e6371a6eaf243ae314f08","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:55.841Z","job_size_bytes":467,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5ecf80f65142b6c4b9cd4a80: done: 1.217965 sec","job_status":"done","queue_duration_s":2.38239,"scheduling_latency_s":2.382433,"gitaly_calls":7,"gitaly_duration_s":0.118584,"redis_calls":51,"redis_duration_s":0.016267,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001329,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006754,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003773,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.018079,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095456,"duration_s":1.217965,"completed_at":"2026-09-06T15:43:59.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086042,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2367gitlab # [ 426.610927] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.445Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8cf3291c-55d7-40fb-a02d-af89b2239abc\"}"],"class":"WebHookWorker","jid":"d74f24a611965afa4aabe1ec","created_at":"2026-09-06T15:43:55.993Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:33064553117b74819355821460a1780525cd6a0915b6d9c92c90a27e65ab15cd","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:55.999Z","job_size_bytes":1751,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d74f24a611965afa4aabe1ec: start","job_status":"start","queue_duration_s":3.445768,"scheduling_latency_s":3.445814}2368gitlab # [ 426.736358] nixbot[3536]: INFO: ::ffff:127.0.0.1:45088 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2369gitlab # [ 426.782875] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.698Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8cf3291c-55d7-40fb-a02d-af89b2239abc\"}"],"class":"WebHookWorker","jid":"d74f24a611965afa4aabe1ec","created_at":"2026-09-06T15:43:55.993Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-df13ab949efd455b","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:33064553117b74819355821460a1780525cd6a0915b6d9c92c90a27e65ab15cd","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:55.999Z","job_size_bytes":1751,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d74f24a611965afa4aabe1ec: done: 0.253199 sec","job_status":"done","queue_duration_s":3.445768,"scheduling_latency_s":3.445814,"redis_calls":19,"redis_duration_s":0.011011,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005269,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000895,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003239,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001608,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0883467200000041,"cpu_s":0.137421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00103144,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.253199,"completed_at":"2026-09-06T15:43:59.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 426.899127] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.706Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"588549bc63834bd017dbd29a","created_at":"2026-09-06T15:43:56.214Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5eb521ddf37ca2b0424d4a56","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.219Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-588549bc63834bd017dbd29a: start","job_status":"start","queue_duration_s":3.48687,"scheduling_latency_s":3.486919}2371gitlab # [ 426.920598] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.797Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"588549bc63834bd017dbd29a","created_at":"2026-09-06T15:43:56.214Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5eb521ddf37ca2b0424d4a56","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.219Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-588549bc63834bd017dbd29a: done: 0.090815 sec","job_status":"done","queue_duration_s":3.48687,"scheduling_latency_s":3.486919,"gitaly_calls":1,"gitaly_duration_s":0.019644,"redis_calls":12,"redis_duration_s":0.004657,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001052,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04978394,"duration_s":0.090815,"completed_at":"2026-09-06T15:43:59.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2372gitlab # [ 426.967194] gitaly[894]: time="2026-09-06T15:43:59.762Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN diskcache=eae1bee5-8e17-4b33-99e7-53ada1eeead2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T21:43:59.746" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.747" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 426.977148] gitaly[894]: time="2026-09-06T15:43:59.763Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T21:43:59.746" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.747" grpc.time_ms=15.526 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2374gitlab # [ 426.990155] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:43:59.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d86f804fe9485774ea0fd55a","created_at":"2026-09-06T15:43:56.440Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e730957994fe1208a38ac2e1e33fc4df06393543eee91718c5845d64f8ed4e2f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.445Z","job_size_bytes":467,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d86f804fe9485774ea0fd55a: start","job_status":"start","queue_duration_s":3.354532,"scheduling_latency_s":3.354569}2375gitlab # [ 427.007629] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:43:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1852376gitlab # [ 427.009831] gitaly[894]: time="2026-09-06T15:43:59.840Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:29.738" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.839" grpc.time_ms=1.099 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2377gitlab # [ 427.023268] gitaly[894]: time="2026-09-06T15:43:59.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T15:44:09.184" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:59.844" grpc.time_ms=19.43 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2378gitlab # [ 427.036267] gitaly[894]: time="2026-09-06T15:43:59.887Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP826Q1QWC0S3XDATYHHT7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:43:59.868" grpc.time_ms=18.641 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2379gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2380gitlab # [ 427.049118] gitaly[894]: time="2026-09-06T15:43:59.940Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:29.838" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.938" grpc.time_ms=1.31 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2381gitlab # [ 427.061281] gitaly[894]: time="2026-09-06T15:43:59.954Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=259 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T15:44:29.846" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:43:59.946" grpc.time_ms=8.076 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2382gitlab # [ 427.096500] gitaly[894]: time="2026-09-06T15:44:00.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:09.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:43:59.998" grpc.time_ms=14.925 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2383gitlab # [ 427.112589] nixbot[3536]: INFO: ::ffff:127.0.0.1:45098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2384gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.06 seconds)2385gitlab # [ 427.124326] gitaly[894]: time="2026-09-06T15:44:00.041Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82CJD0E1WAK6872D2BNV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:00.028" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2386gitlab # [ 427.138106] gitaly[894]: time="2026-09-06T15:44:00.041Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82CJD0E1WAK6872D2BNV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:00.028" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2387gitlab # [ 427.154197] gitlab-workhorse[821]: time="2026-09-06T15:44:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672388gitlab # [ 427.156285] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1512389gitlab # [ 427.158392] gitaly[894]: time="2026-09-06T15:44:00.043Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82CJD0E1WAK6872D2BNV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:00.028" grpc.time_ms=13.018 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2390gitlab # [ 427.173537] nixbot[3536]: {"ts": "2026-09-06T15:44:00.084Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2391gitlab # [ 427.252315] gitaly[894]: time="2026-09-06T15:44:00.169Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:30.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:00.167" grpc.time_ms=1.129 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2392gitlab # [ 427.342298] gitaly[894]: time="2026-09-06T15:44:00.258Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:10.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:00.242" grpc.time_ms=16.269 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2393gitlab # [ 427.420260] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2322394gitlab # [ 427.423904] nixbot[3536]: {"ts": "2026-09-06T15:44:00.339Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2395gitlab # [ 427.495489] gitaly[894]: time="2026-09-06T15:44:00.408Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82TWMJTJ91VPCQTBRR8G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:30.306" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:00.406" grpc.time_ms=1.14 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2396gitlab # [ 427.738057] gitaly[894]: time="2026-09-06T15:44:00.654Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP82TWMJTJ91VPCQTBRR8G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:10.267" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:00.638" grpc.time_ms=15.662 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 427.822976] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3912398gitlab # [ 427.826424] nixbot[3536]: {"ts": "2026-09-06T15:44:00.741Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2399gitlab # [ 427.837135] gitaly[894]: time="2026-09-06T15:44:00.753Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T15:44:30.620" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:00.721" grpc.time_ms=32.493 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2400gitlab # [ 427.877900] gitaly[894]: time="2026-09-06T15:44:00.782Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP59T0W5SMB0JYJNWDAFDN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T15:44:30.659" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:00.760" grpc.time_ms=22.375 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2401gitlab # [ 427.902003] sidekiq-cluster[3428]: {"severity":"WARN","time":"2026-09-06T15:44:00.811Z","class":"CreatePipelineWorker","correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f3cef85b4ae9331176aa86936276de5385bc89d9","after":"631e5202beb049dde21ed2d10f9e5159f2411c94","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"631e5202beb049dde21ed2d10f9e5159f2411c94","ref":"refs/heads/master"},"retry":0}2402gitlab # [ 427.912306] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:00.821Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d86f804fe9485774ea0fd55a","created_at":"2026-09-06T15:43:56.440Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e730957994fe1208a38ac2e1e33fc4df06393543eee91718c5845d64f8ed4e2f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.445Z","job_size_bytes":467,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d86f804fe9485774ea0fd55a: done: 1.021135 sec","job_status":"done","queue_duration_s":3.354532,"scheduling_latency_s":3.354569,"gitaly_calls":7,"gitaly_duration_s":0.129162,"redis_calls":33,"redis_duration_s":0.010289,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.002708,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004674,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001359,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.859044,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.021135,"completed_at":"2026-09-06T15:44:00.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036737,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2403gitlab # [ 427.964679] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:00.824Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5f0abf57-04ec-4e7f-80b8-697834538944\"}"],"class":"WebHookWorker","jid":"0e858b79aee6139e9e9f05a1","created_at":"2026-09-06T15:43:56.478Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:41c8ccf21b813998b70c3b2c953ab5b9b49c2cc4e8d07799bd0a986f5996d93c","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.483Z","job_size_bytes":1749,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e858b79aee6139e9e9f05a1: start","job_status":"start","queue_duration_s":4.34174,"scheduling_latency_s":4.341818}2404gitlab # [ 427.982330] gitaly[894]: time="2026-09-06T15:44:00.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP837D3M9PRD5W30HBB5KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:30.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:00.820" grpc.time_ms=1.219 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2405gitlab # [ 427.995244] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:00.890Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5f0abf57-04ec-4e7f-80b8-697834538944\"}"],"class":"WebHookWorker","jid":"0e858b79aee6139e9e9f05a1","created_at":"2026-09-06T15:43:56.478Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-86ffd0aa5b8b4e1a","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:41c8ccf21b813998b70c3b2c953ab5b9b49c2cc4e8d07799bd0a986f5996d93c","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:56.483Z","job_size_bytes":1749,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0e858b79aee6139e9e9f05a1: done: 0.065652 sec","job_status":"done","queue_duration_s":4.34174,"scheduling_latency_s":4.341818,"redis_calls":14,"redis_duration_s":0.010171,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000431,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007586,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002154,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007870599999989736,"cpu_s":0.034054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.065652,"completed_at":"2026-09-06T15:44:00.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 428.045145] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:00.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c0873d21a011510658cec2b7","created_at":"2026-09-06T15:43:57.220Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.228Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c0873d21a011510658cec2b7: start","job_status":"start","queue_duration_s":3.664061,"scheduling_latency_s":3.66409}2407gitlab # [ 428.061731] nixbot[3536]: INFO: ::ffff:127.0.0.1:45112 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2408gitlab # [ 428.062986] nixbot[3536]: {"ts": "2026-09-06T15:44:00.965Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 \"HTTP/1.1 201 Created\""}2409gitlab # [ 428.065771] gitaly[894]: time="2026-09-06T15:44:00.893Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1VP837D3M9PRD5W30HBB5KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:10.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:00.880" grpc.time_ms=12.049 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2410gitlab # [ 428.079704] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f3cef85b4ae9331176aa86936276de5385bc89d9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2122411gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2412gitlab # [ 428.087244] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c0873d21a011510658cec2b7","created_at":"2026-09-06T15:43:57.220Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.228Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c0873d21a011510658cec2b7: done: 0.111075 sec","job_status":"done","queue_duration_s":3.664061,"scheduling_latency_s":3.66409,"redis_calls":10,"redis_duration_s":0.003632,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030162,"duration_s":0.111075,"completed_at":"2026-09-06T15:44:01.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014764,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2413gitlab # [ 428.132171] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.005Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0b1a493c2dbc0060024410de","created_at":"2026-09-06T15:43:57.442Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.454Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0b1a493c2dbc0060024410de: start","job_status":"start","queue_duration_s":3.55075,"scheduling_latency_s":3.55077}2414gitlab # [ 428.148721] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1012415gitlab # [ 428.150765] gitaly[894]: time="2026-09-06T15:44:01.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP83D250V7WNEJJ4034K7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.018" grpc.time_ms=11.584 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2416gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.07 seconds)2417gitlab # [ 428.163802] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.051Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0b1a493c2dbc0060024410de","created_at":"2026-09-06T15:43:57.442Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.454Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0b1a493c2dbc0060024410de: done: 0.045946 sec","job_status":"done","queue_duration_s":3.55075,"scheduling_latency_s":3.55077,"redis_calls":10,"redis_duration_s":0.006666999999999999,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002908,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004929,"duration_s":0.045946,"completed_at":"2026-09-06T15:44:01.051Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 428.209528] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.056Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a20681bee934ef7c8c3a6cf7","created_at":"2026-09-06T15:43:57.477Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.491Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a20681bee934ef7c8c3a6cf7: start","job_status":"start","queue_duration_s":3.565054,"scheduling_latency_s":3.565077}2419gitlab # [ 428.225406] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.114Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a20681bee934ef7c8c3a6cf7","created_at":"2026-09-06T15:43:57.477Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.491Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a20681bee934ef7c8c3a6cf7: done: 0.05803 sec","job_status":"done","queue_duration_s":3.565054,"scheduling_latency_s":3.565077,"redis_calls":10,"redis_duration_s":0.016576999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002873,"duration_s":0.05803,"completed_at":"2026-09-06T15:44:01.114Z","load_balancing_strategy":"primary","db_duration_s":0.005389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 428.270781] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.117Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a4652cdac46afd969478ea30","created_at":"2026-09-06T15:43:57.518Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.529Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a4652cdac46afd969478ea30: start","job_status":"start","queue_duration_s":3.587652,"scheduling_latency_s":3.587677}2421gitlab # [ 428.286996] nixbot[3536]: INFO: ::ffff:127.0.0.1:45122 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2422gitlab # [ 428.289026] gitlab-workhorse[821]: time="2026-09-06T15:44:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672423gitlab # [ 428.290856] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1052424gitlab # [ 428.292825] gitaly[894]: time="2026-09-06T15:44:01.137Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83GADZAR6C6FWJ465X0A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.124" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2425gitlab # [ 428.303048] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a4652cdac46afd969478ea30","created_at":"2026-09-06T15:43:57.518Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.529Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a4652cdac46afd969478ea30: done: 0.04896 sec","job_status":"done","queue_duration_s":3.587652,"scheduling_latency_s":3.587677,"redis_calls":13,"redis_duration_s":0.005272,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003573,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000848,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024944,"duration_s":0.04896,"completed_at":"2026-09-06T15:44:01.166Z","load_balancing_strategy":"primary","db_duration_s":0.008492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 428.348911] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bfc4f5661c568169d565bc23","created_at":"2026-09-06T15:43:57.530Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.539Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bfc4f5661c568169d565bc23: start","job_status":"start","queue_duration_s":3.628993,"scheduling_latency_s":3.629011}2427gitlab # [ 428.365185] gitaly[894]: time="2026-09-06T15:44:01.137Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83GADZAR6C6FWJ465X0A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.124" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2428gitlab # [ 428.378694] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 652429gitlab # [ 428.380828] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bfc4f5661c568169d565bc23","created_at":"2026-09-06T15:43:57.530Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.539Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bfc4f5661c568169d565bc23: done: 0.039652 sec","job_status":"done","queue_duration_s":3.628993,"scheduling_latency_s":3.629011,"redis_calls":10,"redis_duration_s":0.002102,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037446,"duration_s":0.039652,"completed_at":"2026-09-06T15:44:01.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2430gitlab # [ 428.425550] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c1a91e56af65be960e06ebe5","created_at":"2026-09-06T15:43:57.540Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.549Z","job_size_bytes":19,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c1a91e56af65be960e06ebe5: start","job_status":"start","queue_duration_s":3.659222,"scheduling_latency_s":3.65924}2431gitlab # [ 428.441607] gitaly[894]: time="2026-09-06T15:44:01.138Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83GADZAR6C6FWJ465X0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.124" grpc.time_ms=13.284 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2432gitlab # [ 428.457036] gitlab-workhorse[821]: time="2026-09-06T15:44:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672433gitlab # [ 428.458846] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 712434gitlab # [ 428.460933] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.243Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c1a91e56af65be960e06ebe5","created_at":"2026-09-06T15:43:57.540Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.549Z","job_size_bytes":19,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c1a91e56af65be960e06ebe5: done: 0.034355 sec","job_status":"done","queue_duration_s":3.659222,"scheduling_latency_s":3.65924,"redis_calls":11,"redis_duration_s":0.001771,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000389,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023726,"duration_s":0.034355,"completed_at":"2026-09-06T15:44:01.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 428.505440] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.244Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"958101570f2530fc57e87772","created_at":"2026-09-06T15:43:57.554Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.565Z","job_size_bytes":66,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-958101570f2530fc57e87772: start","job_status":"start","queue_duration_s":3.679599,"scheduling_latency_s":3.679616}2436gitlab # [ 428.523516] gitaly[894]: time="2026-09-06T15:44:01.265Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP83NGWV0Y8HGWMSE01290 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.257" grpc.time_ms=8.029 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2437gitlab # [ 428.536361] gitaly[894]: time="2026-09-06T15:44:01.339Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83QM67P0E7CD3Y2KJ21Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.331" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2438gitlab # [ 428.546306] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.285Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"958101570f2530fc57e87772","created_at":"2026-09-06T15:43:57.554Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.565Z","job_size_bytes":66,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-958101570f2530fc57e87772: done: 0.040859 sec","job_status":"done","queue_duration_s":3.679599,"scheduling_latency_s":3.679616,"redis_calls":10,"redis_duration_s":0.0068520000000000005,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00134828,"duration_s":0.040859,"completed_at":"2026-09-06T15:44:01.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 428.590859] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5369bd5ba664a741c54aae1c","created_at":"2026-09-06T15:43:57.567Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.577Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5369bd5ba664a741c54aae1c: start","job_status":"start","queue_duration_s":3.7119,"scheduling_latency_s":3.711925}2440gitlab # [ 428.606860] gitaly[894]: time="2026-09-06T15:44:01.339Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83QM67P0E7CD3Y2KJ21Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.331" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2441gitlab # [ 428.620333] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5369bd5ba664a741c54aae1c","created_at":"2026-09-06T15:43:57.567Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.577Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5369bd5ba664a741c54aae1c: done: 0.075214 sec","job_status":"done","queue_duration_s":3.7119,"scheduling_latency_s":3.711925,"redis_calls":10,"redis_duration_s":0.003784,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000974,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028378,"duration_s":0.075214,"completed_at":"2026-09-06T15:44:01.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2442gitlab # [ 428.664941] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.367Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c8b8341750ad75e9d9dcd6a3","created_at":"2026-09-06T15:43:57.595Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.606Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c8b8341750ad75e9d9dcd6a3: start","job_status":"start","queue_duration_s":3.760963,"scheduling_latency_s":3.760982}2443gitlab # [ 428.681617] gitaly[894]: time="2026-09-06T15:44:01.339Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83QM67P0E7CD3Y2KJ21Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:01.331" grpc.time_ms=8.522 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2444gitlab # [ 428.695742] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.411Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c8b8341750ad75e9d9dcd6a3","created_at":"2026-09-06T15:43:57.595Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.606Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c8b8341750ad75e9d9dcd6a3: done: 0.044594 sec","job_status":"done","queue_duration_s":3.760963,"scheduling_latency_s":3.760982,"redis_calls":10,"redis_duration_s":0.004191,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000825,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032442,"duration_s":0.044594,"completed_at":"2026-09-06T15:44:01.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2445gitlab # [ 428.740087] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.413Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f5508ffe2832357526616acd","created_at":"2026-09-06T15:43:57.607Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.616Z","job_size_bytes":6,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f5508ffe2832357526616acd: start","job_status":"start","queue_duration_s":3.796541,"scheduling_latency_s":3.79656}2446gitlab # [ 428.755504] gitaly[894]: time="2026-09-06T15:44:01.444Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:31.342" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:01.442" grpc.time_ms=1.53 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2447gitlab # [ 428.767889] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f5508ffe2832357526616acd","created_at":"2026-09-06T15:43:57.607Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.616Z","job_size_bytes":6,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f5508ffe2832357526616acd: done: 0.02879 sec","job_status":"done","queue_duration_s":3.796541,"scheduling_latency_s":3.79656,"redis_calls":10,"redis_duration_s":0.003071,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001184,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034836,"duration_s":0.02879,"completed_at":"2026-09-06T15:44:01.442Z","load_balancing_strategy":"primary","db_duration_s":0.004158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2448gitlab # [ 428.811224] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1584694df50879b3a0ed7a75","created_at":"2026-09-06T15:43:57.617Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.626Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1584694df50879b3a0ed7a75: start","job_status":"start","queue_duration_s":3.817691,"scheduling_latency_s":3.817709}2449gitlab # [ 428.826509] gitaly[894]: time="2026-09-06T15:44:01.466Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T15:44:31.355" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:01.456" grpc.time_ms=10.365 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2450gitlab # [ 428.840357] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1584694df50879b3a0ed7a75","created_at":"2026-09-06T15:43:57.617Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.626Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1584694df50879b3a0ed7a75: done: 0.054505 sec","job_status":"done","queue_duration_s":3.817691,"scheduling_latency_s":3.817709,"redis_calls":10,"redis_duration_s":0.007716000000000001,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001586,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004772,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003193,"duration_s":0.054505,"completed_at":"2026-09-06T15:44:01.498Z","load_balancing_strategy":"primary","db_duration_s":0.01575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 428.884140] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.499Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"15a5c10b77269dd79b6283bc","created_at":"2026-09-06T15:43:57.637Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.646Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-15a5c10b77269dd79b6283bc: start","job_status":"start","queue_duration_s":3.853375,"scheduling_latency_s":3.853398}2452gitlab # [ 428.899774] gitaly[894]: time="2026-09-06T15:44:01.495Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:11.105" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:01.475" grpc.time_ms=20.228 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2453gitlab # [ 428.913156] nixbot[3536]: {"ts": "2026-09-06T15:44:01.763Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 \"HTTP/1.1 201 Created\""}2454gitlab # [ 428.915840] nixbot[3536]: {"ts": "2026-09-06T15:44:01.773Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-631e5202beb0-5"}2455gitlab # [ 428.918619] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.591Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"15a5c10b77269dd79b6283bc","created_at":"2026-09-06T15:43:57.637Z","trace_propagation_headers":{"sentry-trace":"037f274ae6d34df3a8d6a925e2fceda5-48a7b862f5af49ff","baggage":"sentry-trace_id=037f274ae6d34df3a8d6a925e2fceda5,sentry-release=Unknown"},"correlation_id":"01M1VP5B1BQ1DPVPKDHRKSE7ZM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.646Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-15a5c10b77269dd79b6283bc: done: 0.092079 sec","job_status":"done","queue_duration_s":3.853375,"scheduling_latency_s":3.853398,"redis_calls":14,"redis_duration_s":0.005436,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001487,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049196,"duration_s":0.092079,"completed_at":"2026-09-06T15:44:01.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 428.961917] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"bac7773e1e31e938cc795f4b","created_at":"2026-09-06T15:43:57.945Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-c6e2a9d6f0074a39","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.956Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-bac7773e1e31e938cc795f4b: start","job_status":"start","queue_duration_s":3.640049,"scheduling_latency_s":3.640069}2457gitlab # [ 428.977689] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3802458gitlab # [ 428.980163] gitaly[894]: time="2026-09-06T15:44:01.532Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T15:44:11.161" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:44:01.531" grpc.time_ms=0.355 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2459gitlab # [ 428.990758] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"bac7773e1e31e938cc795f4b","created_at":"2026-09-06T15:43:57.945Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-c6e2a9d6f0074a39","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:57.956Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-bac7773e1e31e938cc795f4b: done: 0.057805 sec","job_status":"done","queue_duration_s":3.640049,"scheduling_latency_s":3.640069,"redis_calls":19,"redis_duration_s":0.006058,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00077,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000524,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003299,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00858836,"duration_s":0.057805,"completed_at":"2026-09-06T15:44:01.654Z","load_balancing_strategy":"primary","db_duration_s":0.009078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2460gitlab # [ 429.036650] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.655Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d74f24a611965afa4aabe1ec"],"class":"WebHooks::LogExecutionWorker","jid":"2444d63af19a97f6fb7125f3","created_at":"2026-09-06T15:43:59.658Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-e393c5a726b94e28","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ab86aa32353a158519c9510954d1cb4ed73e893e3cee178976014ceffcf61f3","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:59.676Z","job_size_bytes":2593,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2444d63af19a97f6fb7125f3: start","job_status":"start","queue_duration_s":1.979451,"scheduling_latency_s":1.979471}2461gitlab # [ 429.053770] gitaly[894]: time="2026-09-06T15:44:01.545Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T15:44:11.167" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:01.537" grpc.time_ms=7.727 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2462gitlab # [ 429.068138] gitaly[894]: time="2026-09-06T15:44:01.592Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:01.591" grpc.time_ms=0.403 pid=894 span.kind=server system=grpc2463gitlab # [ 429.077647] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.706Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d74f24a611965afa4aabe1ec"],"class":"WebHooks::LogExecutionWorker","jid":"2444d63af19a97f6fb7125f3","created_at":"2026-09-06T15:43:59.658Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-e393c5a726b94e28","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ab86aa32353a158519c9510954d1cb4ed73e893e3cee178976014ceffcf61f3","size_limiter":"validated","enqueued_at":"2026-09-06T15:43:59.676Z","job_size_bytes":2593,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2444d63af19a97f6fb7125f3: done: 0.05118 sec","job_status":"done","queue_duration_s":1.979451,"scheduling_latency_s":1.979471,"redis_calls":10,"redis_duration_s":0.003747,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032338,"duration_s":0.05118,"completed_at":"2026-09-06T15:44:01.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2464gitlab # [ 429.121929] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:01.708Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4b19e2683bb40893f62379e","created_at":"2026-09-06T15:44:00.311Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-043bf0309835441a","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:00.317Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4b19e2683bb40893f62379e: start","job_status":"start","queue_duration_s":1.391504,"scheduling_latency_s":1.391525}2465gitlab # [ 429.137398] nixbot[3536]: {"ts": "2026-09-06T15:44:01.986Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-631e5202beb0-5", "argv0": "bwrap"}2466gitlab # [ 429.139693] gitaly[894]: time="2026-09-06T15:44:01.635Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:01.633" grpc.time_ms=1.975 pid=894 span.kind=server system=grpc2467gitlab # [ 429.149357] gitaly[894]: time="2026-09-06T15:44:01.643Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 diskcache=1b052280-1352-4f77-8527-167b56d7b62b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:44:11.178" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:44:01.548" pid=894 ref=refs/keep-around/631e5202beb049dde21ed2d10f9e5159f2411c94 remote_ip="2001:db8:1::1" revision=631e5202beb049dde21ed2d10f9e5159f2411c94 span.kind=server system=grpc username=root2468gitlab # [ 429.160801] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.037Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4b19e2683bb40893f62379e","created_at":"2026-09-06T15:44:00.311Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-043bf0309835441a","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:00.317Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3428,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e4b19e2683bb40893f62379e: rescheduled"}2469gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94'2470gitlab # [ 429.175524] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e4b19e2683bb40893f62379e","created_at":"2026-09-06T15:44:00.311Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-043bf0309835441a","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:00.317Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e4b19e2683bb40893f62379e: done: 0.337779 sec","job_status":"done","queue_duration_s":1.391504,"scheduling_latency_s":1.391525,"gitaly_calls":3,"gitaly_duration_s":0.112457,"redis_calls":67,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014747,"redis_read_bytes":152,"redis_write_bytes":18097,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000432,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001047,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003667,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006062,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000319,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000863,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.165581,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.28077454,"duration_s":0.337779,"completed_at":"2026-09-06T15:44:02.046Z","load_balancing_strategy":"primary","db_duration_s":0.057128,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2471gitlab # [ 429.223895] gitaly[894]: time="2026-09-06T15:44:01.644Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5487 command.oublock=8 command.real_time_ms=90 command.spawn_token_fork_ms=2 command.system_time_ms=49 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T15:44:11.178" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T15:44:01.548" grpc.time_ms=95.359 pid=894 ref=refs/keep-around/631e5202beb049dde21ed2d10f9e5159f2411c94 remote_ip="2001:db8:1::1" revision=631e5202beb049dde21ed2d10f9e5159f2411c94 span.kind=server system=grpc username=root2472gitlab # [ 429.238396] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.048Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e858b79aee6139e9e9f05a1"],"class":"WebHooks::LogExecutionWorker","jid":"83c31783c5471fc4b14736cd","created_at":"2026-09-06T15:44:00.876Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-d1dd714035e440e5","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:709d4a30ba47c97b25d614632a5ae580c9eb69c45fb37892f43cdf8cb188c69b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:00.879Z","job_size_bytes":2591,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-83c31783c5471fc4b14736cd: start","job_status":"start","queue_duration_s":1.168643,"scheduling_latency_s":1.168669}2473gitlab # [ 429.255163] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.077Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0e858b79aee6139e9e9f05a1"],"class":"WebHooks::LogExecutionWorker","jid":"83c31783c5471fc4b14736cd","created_at":"2026-09-06T15:44:00.876Z","trace_propagation_headers":{"sentry-trace":"1061a83614334cbaa52591104347008c-d1dd714035e440e5","baggage":"sentry-trace_id=1061a83614334cbaa52591104347008c,sentry-release=Unknown"},"correlation_id":"01M1VP59T0W5SMB0JYJNWDAFDN","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:709d4a30ba47c97b25d614632a5ae580c9eb69c45fb37892f43cdf8cb188c69b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:00.879Z","job_size_bytes":2591,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-83c31783c5471fc4b14736cd: done: 0.029034 sec","job_status":"done","queue_duration_s":1.168643,"scheduling_latency_s":1.168669,"redis_calls":7,"redis_duration_s":0.001813,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029034,"completed_at":"2026-09-06T15:44:02.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94', in 0.11 seconds)2475(finished: subtest: push delivers the webhook, in 93.33 seconds)2476subtest: eval and build post commit statuses2477gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2478gitlab # [ 429.299926] gitaly[894]: time="2026-09-06T15:44:01.647Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:31.546" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:01.647" grpc.time_ms=0.37 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2479gitlab # [ 429.312459] gitaly[894]: time="2026-09-06T15:44:01.849Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:01.849" grpc.time_ms=0.443 pid=894 span.kind=server system=grpc2480gitlab # [ 429.322224] nixbot[3536]: INFO: ::ffff:127.0.0.1:45134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 200 OK2481gitlab # [ 429.324159] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.078Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d5f1e6c2f3353238568283e1","created_at":"2026-09-06T15:44:01.639Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-3dbe8baeaf4c4758","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.644Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d5f1e6c2f3353238568283e1: start","job_status":"start","queue_duration_s":0.434146,"scheduling_latency_s":0.434169}2482gitlab # [ 429.340824] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d5f1e6c2f3353238568283e1","created_at":"2026-09-06T15:44:01.639Z","trace_propagation_headers":{"sentry-trace":"a4a118f3fba545d387ffc14fefbe87b6-3dbe8baeaf4c4758","baggage":"sentry-trace_id=a4a118f3fba545d387ffc14fefbe87b6,sentry-release=Unknown"},"correlation_id":"01M1VP53DZFXX6D2AM7E6AH6PM","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.644Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d5f1e6c2f3353238568283e1: done: 0.121682 sec","job_status":"done","queue_duration_s":0.434146,"scheduling_latency_s":0.434169,"redis_calls":11,"redis_duration_s":0.00222,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025524,"duration_s":0.121682,"completed_at":"2026-09-06T15:44:02.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 429.386132] gitaly[894]: time="2026-09-06T15:44:01.877Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:01.875" grpc.time_ms=1.838 pid=894 span.kind=server system=grpc2484gitlab # [ 429.395904] gitaly[894]: time="2026-09-06T15:44:01.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:01.905" grpc.time_ms=0.44 pid=894 span.kind=server system=grpc2485gitlab # [ 429.405879] nix-daemon[3767]: accepted connection from pid 4456, user nixbot2486gitlab # [ 429.406856] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.204Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fc402222df8b1601e66dd77c","created_at":"2026-09-06T15:44:01.658Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.663Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fc402222df8b1601e66dd77c: start","job_status":"start","queue_duration_s":0.540767,"scheduling_latency_s":0.540818}2487gitlab # [ 429.423481] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.285Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fc402222df8b1601e66dd77c","created_at":"2026-09-06T15:44:01.658Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.663Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fc402222df8b1601e66dd77c: done: 0.081328 sec","job_status":"done","queue_duration_s":0.540767,"scheduling_latency_s":0.540818,"redis_calls":7,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081328,"completed_at":"2026-09-06T15:44:02.285Z","load_balancing_strategy":"primary","db_duration_s":0.019215,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2488gitlab # [ 429.466655] gitaly[894]: time="2026-09-06T15:44:01.916Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 diskcache=198c7b28-54fd-4f1f-97de-03a8fb97722b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:31.714" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:01.815" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2489gitlab # [ 429.477784] gitaly[894]: time="2026-09-06T15:44:01.917Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=104 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7286 command.oublock=0 command.real_time_ms=96 command.spawn_token_fork_ms=0 command.system_time_ms=52 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:31.714" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:01.815" grpc.time_ms=101.497 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2490gitlab # [ 429.490870] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.287Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ca6abfa0d0d02513608df35a","created_at":"2026-09-06T15:44:01.665Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.669Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ca6abfa0d0d02513608df35a: start","job_status":"start","queue_duration_s":0.618147,"scheduling_latency_s":0.618181}2491gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.21 seconds)2492gitlab # [ 429.508871] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.381Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ca6abfa0d0d02513608df35a","created_at":"2026-09-06T15:44:01.665Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.669Z","job_size_bytes":65,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ca6abfa0d0d02513608df35a: done: 0.094133 sec","job_status":"done","queue_duration_s":0.618147,"scheduling_latency_s":0.618181,"redis_calls":10,"redis_duration_s":0.003193,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.094133,"completed_at":"2026-09-06T15:44:02.381Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2493gitlab # [ 429.552646] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1122494gitlab # [ 429.555502] gitaly[894]: time="2026-09-06T15:44:01.983Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:31.881" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:01.982" grpc.time_ms=0.908 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2495gitlab # [ 429.568287] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.384Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ba90058156b4a67c3648c2d","created_at":"2026-09-06T15:44:01.744Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.748Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8ba90058156b4a67c3648c2d: start","job_status":"start","queue_duration_s":0.635784,"scheduling_latency_s":0.63582}2496gitlab # [ 429.584083] gitaly[894]: time="2026-09-06T15:44:02.025Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP82K8PGQGTC9QGBXJH6M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:32.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:02.024" grpc.time_ms=0.908 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab # [ 429.596051] gitaly[894]: time="2026-09-06T15:44:02.368Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP84QKRKR42QWKA85Z1JX7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:32.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:02.367" grpc.time_ms=1.089 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2498gitlab # [ 429.608613] gitaly[894]: time="2026-09-06T15:44:02.501Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:32.398" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:02.499" grpc.time_ms=1.436 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2499gitlab # [ 429.637592] gitaly[894]: time="2026-09-06T15:44:02.554Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP83V666SNBKJAZ6SBNWH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:32.452" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:02.553" grpc.time_ms=0.859 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2500gitlab # [ 429.665471] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.581Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ba90058156b4a67c3648c2d","created_at":"2026-09-06T15:44:01.744Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-44777885e745491b","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.748Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8ba90058156b4a67c3648c2d: done: 0.197045 sec","job_status":"done","queue_duration_s":0.635784,"scheduling_latency_s":0.63582,"gitaly_calls":2,"gitaly_duration_s":0.009103,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01031,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00122,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001722,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000472,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002543,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00036,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000861,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141966,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13573856,"duration_s":0.197045,"completed_at":"2026-09-06T15:44:02.580Z","load_balancing_strategy":"primary","db_duration_s":0.044517,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2501gitlab # [ 429.725543] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.584Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"05c4b500a53c1b086275863a","created_at":"2026-09-06T15:44:01.804Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.807Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-05c4b500a53c1b086275863a: start","job_status":"start","queue_duration_s":0.776855,"scheduling_latency_s":0.776908}2502gitlab # [ 429.757711] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"05c4b500a53c1b086275863a","created_at":"2026-09-06T15:44:01.804Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.807Z","job_size_bytes":23,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-05c4b500a53c1b086275863a: done: 0.089355 sec","job_status":"done","queue_duration_s":0.776855,"scheduling_latency_s":0.776908,"redis_calls":7,"redis_duration_s":0.002702,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.089355,"completed_at":"2026-09-06T15:44:02.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015609,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2503gitlab # [ 429.800393] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7e200a35f205ae5a09cab447","created_at":"2026-09-06T15:44:01.922Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.925Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7e200a35f205ae5a09cab447: start","job_status":"start","queue_duration_s":0.751541,"scheduling_latency_s":0.751588}2504gitlab # [ 429.817035] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.728Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7e200a35f205ae5a09cab447","created_at":"2026-09-06T15:44:01.922Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.925Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7e200a35f205ae5a09cab447: done: 0.051969 sec","job_status":"done","queue_duration_s":0.751541,"scheduling_latency_s":0.751588,"redis_calls":7,"redis_duration_s":0.002396,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051969,"completed_at":"2026-09-06T15:44:02.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 429.860142] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"87d7b3fc9ddc79c36ae408c5","created_at":"2026-09-06T15:44:01.933Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.936Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-87d7b3fc9ddc79c36ae408c5: start","job_status":"start","queue_duration_s":0.79455,"scheduling_latency_s":0.794584}2506gitlab # [ 429.875728] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"87d7b3fc9ddc79c36ae408c5","created_at":"2026-09-06T15:44:01.933Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.936Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-87d7b3fc9ddc79c36ae408c5: done: 0.049297 sec","job_status":"done","queue_duration_s":0.79455,"scheduling_latency_s":0.794584,"redis_calls":7,"redis_duration_s":0.002393,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049297,"completed_at":"2026-09-06T15:44:02.780Z","load_balancing_strategy":"primary","db_duration_s":0.009288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 429.919699] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.782Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"c327c6accfe0152c76c84b66","created_at":"2026-09-06T15:44:01.945Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.948Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c327c6accfe0152c76c84b66: start","job_status":"start","queue_duration_s":0.834525,"scheduling_latency_s":0.834558}2508gitlab # [ 429.935228] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.830Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"c327c6accfe0152c76c84b66","created_at":"2026-09-06T15:44:01.945Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.948Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-c327c6accfe0152c76c84b66: done: 0.048058 sec","job_status":"done","queue_duration_s":0.834525,"scheduling_latency_s":0.834558,"redis_calls":10,"redis_duration_s":0.002984,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000823,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048058,"completed_at":"2026-09-06T15:44:02.830Z","load_balancing_strategy":"primary","db_duration_s":0.009753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 429.978839] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9d97e06ee3a9b40988fd1d94","created_at":"2026-09-06T15:44:01.949Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.952Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9d97e06ee3a9b40988fd1d94: start","job_status":"start","queue_duration_s":0.880272,"scheduling_latency_s":0.880302}2510gitlab # [ 429.995657] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9d97e06ee3a9b40988fd1d94","created_at":"2026-09-06T15:44:01.949Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.952Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9d97e06ee3a9b40988fd1d94: done: 0.037781 sec","job_status":"done","queue_duration_s":0.880272,"scheduling_latency_s":0.880302,"redis_calls":7,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037781,"completed_at":"2026-09-06T15:44:02.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab # [ 430.038825] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4cd04565e45bb694e73786a6","created_at":"2026-09-06T15:44:01.953Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.957Z","job_size_bytes":19,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4cd04565e45bb694e73786a6: start","job_status":"start","queue_duration_s":0.915266,"scheduling_latency_s":0.915293}2512gitlab # [ 430.055268] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.915Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4cd04565e45bb694e73786a6","created_at":"2026-09-06T15:44:01.953Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.957Z","job_size_bytes":19,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4cd04565e45bb694e73786a6: done: 0.042569 sec","job_status":"done","queue_duration_s":0.915266,"scheduling_latency_s":0.915293,"redis_calls":8,"redis_duration_s":0.003446,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002715,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042569,"completed_at":"2026-09-06T15:44:02.915Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2513gitlab # [ 430.098968] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.918Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"60ae59389c86430fa06e8d5f","created_at":"2026-09-06T15:44:01.958Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.961Z","job_size_bytes":66,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-60ae59389c86430fa06e8d5f: start","job_status":"start","queue_duration_s":0.957446,"scheduling_latency_s":0.957493}2514gitlab # [ 430.116740] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.975Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"60ae59389c86430fa06e8d5f","created_at":"2026-09-06T15:44:01.958Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.961Z","job_size_bytes":66,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-60ae59389c86430fa06e8d5f: done: 0.057494 sec","job_status":"done","queue_duration_s":0.957446,"scheduling_latency_s":0.957493,"redis_calls":7,"redis_duration_s":0.002604,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057494,"completed_at":"2026-09-06T15:44:02.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 430.160125] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:02.979Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d11b8aca39f5e8a14f02c98c","created_at":"2026-09-06T15:44:01.961Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.963Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d11b8aca39f5e8a14f02c98c: start","job_status":"start","queue_duration_s":1.015167,"scheduling_latency_s":1.015203}2516gitlab # [ 430.176070] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.030Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"d11b8aca39f5e8a14f02c98c","created_at":"2026-09-06T15:44:01.961Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.963Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d11b8aca39f5e8a14f02c98c: done: 0.052014 sec","job_status":"done","queue_duration_s":1.015167,"scheduling_latency_s":1.015203,"redis_calls":7,"redis_duration_s":0.002685,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052014,"completed_at":"2026-09-06T15:44:03.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2517gitlab # [ 430.218312] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c5ac4ba8b853fa4d568d9e2a","created_at":"2026-09-06T15:44:01.964Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.966Z","job_size_bytes":6,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c5ac4ba8b853fa4d568d9e2a: start","job_status":"start","queue_duration_s":1.067427,"scheduling_latency_s":1.067464}2518gitlab # [ 430.233913] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c5ac4ba8b853fa4d568d9e2a","created_at":"2026-09-06T15:44:01.964Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.966Z","job_size_bytes":6,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c5ac4ba8b853fa4d568d9e2a: done: 0.028336 sec","job_status":"done","queue_duration_s":1.067427,"scheduling_latency_s":1.067464,"redis_calls":7,"redis_duration_s":0.002568,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028336,"completed_at":"2026-09-06T15:44:03.062Z","load_balancing_strategy":"primary","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 430.275265] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.064Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5c023443816fc417c4b285f2","created_at":"2026-09-06T15:44:01.967Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.968Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5c023443816fc417c4b285f2: start","job_status":"start","queue_duration_s":1.095817,"scheduling_latency_s":1.095846}2520gitlab # [ 430.290542] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5c023443816fc417c4b285f2","created_at":"2026-09-06T15:44:01.967Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:01.968Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5c023443816fc417c4b285f2: done: 0.039595 sec","job_status":"done","queue_duration_s":1.095817,"scheduling_latency_s":1.095846,"redis_calls":7,"redis_duration_s":0.002336,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039595,"completed_at":"2026-09-06T15:44:03.104Z","load_balancing_strategy":"primary","db_duration_s":0.006302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2521gitlab # [ 430.332410] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.106Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7546fe9e696ddf85c963c58a","created_at":"2026-09-06T15:44:02.037Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:02.040Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7546fe9e696ddf85c963c58a: start","job_status":"start","queue_duration_s":1.066129,"scheduling_latency_s":1.066156}2522gitlab # [ 430.347914] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.147Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7546fe9e696ddf85c963c58a","created_at":"2026-09-06T15:44:02.037Z","trace_propagation_headers":{"sentry-trace":"52a90fde9c1746169a3ad3abd2582f2d-572e1552b7494b58","baggage":"sentry-trace_id=52a90fde9c1746169a3ad3abd2582f2d,sentry-release=Unknown"},"correlation_id":"01M1VP82K8PGQGTC9QGBXJH6M3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:02.040Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7546fe9e696ddf85c963c58a: done: 0.040614 sec","job_status":"done","queue_duration_s":1.066129,"scheduling_latency_s":1.066156,"redis_calls":8,"redis_duration_s":0.002339,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001815,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040614,"completed_at":"2026-09-06T15:44:03.147Z","load_balancing_strategy":"primary","db_duration_s":0.006931,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2523gitlab # [ 430.389255] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"53071e812bc49975efac87a4","created_at":"2026-09-06T15:44:02.476Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-8267ea69e6e3434c","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:02.478Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-53071e812bc49975efac87a4: start","job_status":"start","queue_duration_s":0.670116,"scheduling_latency_s":0.670141}2524gitlab # [ 430.405175] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:03.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"53071e812bc49975efac87a4","created_at":"2026-09-06T15:44:02.476Z","trace_propagation_headers":{"sentry-trace":"1611a2e21857482cb5b6fb4c357c7a73-8267ea69e6e3434c","baggage":"sentry-trace_id=1611a2e21857482cb5b6fb4c357c7a73,sentry-release=Unknown"},"correlation_id":"01M1VP83V666SNBKJAZ6SBNWH1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:02.478Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-53071e812bc49975efac87a4: done: 0.048346 sec","job_status":"done","queue_duration_s":0.670116,"scheduling_latency_s":0.670141,"redis_calls":7,"redis_duration_s":0.0021520000000000003,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048346,"completed_at":"2026-09-06T15:44:03.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008615,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2525gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2526gitlab # [ 430.693908] gitaly[894]: time="2026-09-06T15:44:03.609Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP85XY3VPVXAYT12YQ6MZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:33.407" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:03.608" grpc.time_ms=1.169 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.23 seconds)2528gitlab # [ 430.738278] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1352529gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2530gitlab # [ 431.893397] gitaly[894]: time="2026-09-06T15:44:04.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8735HGJ8JN3ZT7JPDX93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:34.606" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:04.807" grpc.time_ms=1.232 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2531gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.20 seconds)2532gitlab # [ 431.941805] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1472533gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2534gitlab # [ 433.098531] gitaly[894]: time="2026-09-06T15:44:06.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP888SSF33WMVX28KFXDM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:36.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:06.012" grpc.time_ms=1.287 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2535gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.21 seconds)2536gitlab # [ 433.152257] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1542537gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2538gitlab # [ 434.253889] nix-daemon[3767]: accepted connection from pid 4492, user nixbot2539gitlab # [ 434.273910] nix-daemon[3767]: accepted connection from pid 4456, user nixbot2540gitlab # [ 434.316522] gitaly[894]: time="2026-09-06T15:44:07.232Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP89EM6X1AS4D9VF7FMJXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:37.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:07.230" grpc.time_ms=1.323 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2541gitlab # [ 434.371644] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1612542gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.22 seconds)2543gitlab # [ 435.072360] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:07.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7ac3d4abaa2eb37a29acc1d","created_at":"2026-09-06T15:44:07.958Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1beda66247762bbe1cd9108d51670337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:07.984Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7ac3d4abaa2eb37a29acc1d: start","job_status":"start","queue_duration_s":0.003285,"scheduling_latency_s":0.003338}2544gitlab # [ 435.203603] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7ac3d4abaa2eb37a29acc1d","created_at":"2026-09-06T15:44:07.958Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1beda66247762bbe1cd9108d51670337","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:07.984Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7ac3d4abaa2eb37a29acc1d: done: 0.131824 sec","job_status":"done","queue_duration_s":0.003285,"scheduling_latency_s":0.003338,"redis_calls":11,"redis_duration_s":0.021346,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00814,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0023476,"exclusive_lock_hold_duration_s":0.02524926,"duration_s":0.131824,"completed_at":"2026-09-06T15:44:08.119Z","load_balancing_strategy":"primary","db_duration_s":0.016627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2545gitlab # [ 435.292809] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"79e42d576db44c71cfce4370","created_at":"2026-09-06T15:44:07.997Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cd829bb92afcde940d9061486253c94","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.013Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-79e42d576db44c71cfce4370: start","job_status":"start","queue_duration_s":0.111793,"scheduling_latency_s":0.111846}2546gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2547gitlab # [ 435.351869] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"79e42d576db44c71cfce4370","created_at":"2026-09-06T15:44:07.997Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cd829bb92afcde940d9061486253c94","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.013Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-79e42d576db44c71cfce4370: done: 0.14256 sec","job_status":"done","queue_duration_s":0.111793,"scheduling_latency_s":0.111846,"redis_calls":9,"redis_duration_s":0.025435,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008865,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003113,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.14256,"completed_at":"2026-09-06T15:44:08.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2548gitlab # [ 435.453027] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.272Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"63d6472ee5869241352629a8","created_at":"2026-09-06T15:44:08.021Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a86757fdd32f3dfbb81dd4a8900b916","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.049Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-63d6472ee5869241352629a8: start","job_status":"start","queue_duration_s":0.222782,"scheduling_latency_s":0.222832}2549gitlab # [ 435.471167] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"63d6472ee5869241352629a8","created_at":"2026-09-06T15:44:08.021Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a86757fdd32f3dfbb81dd4a8900b916","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.049Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-63d6472ee5869241352629a8: done: 0.083996 sec","job_status":"done","queue_duration_s":0.222782,"scheduling_latency_s":0.222832,"redis_calls":11,"redis_duration_s":0.028058,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.003365,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004069,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083996,"completed_at":"2026-09-06T15:44:08.356Z","load_balancing_strategy":"primary","db_duration_s":0.002429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2550gitlab # [ 435.516130] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"63f70fcbe88ca7e8abfacabd","created_at":"2026-09-06T15:44:08.081Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f0db2a125327f50c6e8f1d8cd5addd5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.154Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-63f70fcbe88ca7e8abfacabd: start","job_status":"start","queue_duration_s":0.219575,"scheduling_latency_s":0.219619}2551gitlab # [ 435.530621] gitaly[894]: time="2026-09-06T15:44:08.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8AN08HF9DESE83GREQMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:38.231" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:08.432" grpc.time_ms=0.93 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2552gitlab # [ 435.570050] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1312553gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.20 seconds)2554gitlab # [ 435.628242] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"63f70fcbe88ca7e8abfacabd","created_at":"2026-09-06T15:44:08.081Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f0db2a125327f50c6e8f1d8cd5addd5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.154Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-63f70fcbe88ca7e8abfacabd: done: 0.17014 sec","job_status":"done","queue_duration_s":0.219575,"scheduling_latency_s":0.219619,"redis_calls":11,"redis_duration_s":0.036087,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006665,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.022924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00233044,"exclusive_lock_hold_duration_s":0.03367328,"duration_s":0.17014,"completed_at":"2026-09-06T15:44:08.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2555gitlab # [ 435.715522] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1b360bec954d64832c13b9cc","created_at":"2026-09-06T15:44:08.178Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca4ef4ac19a47976408882c1ce81dad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.194Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1b360bec954d64832c13b9cc: start","job_status":"start","queue_duration_s":0.360191,"scheduling_latency_s":0.360237}2556gitlab # [ 435.732857] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.639Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2557gitlab # [ 435.760086] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1b360bec954d64832c13b9cc","created_at":"2026-09-06T15:44:08.178Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca4ef4ac19a47976408882c1ce81dad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.194Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1b360bec954d64832c13b9cc: done: 0.120529 sec","job_status":"done","queue_duration_s":0.360191,"scheduling_latency_s":0.360237,"redis_calls":9,"redis_duration_s":0.029049,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.012693,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120529,"completed_at":"2026-09-06T15:44:08.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2558gitlab # [ 435.844740] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:08.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"34053a006daec2bd2ab00bdb","created_at":"2026-09-06T15:44:08.216Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b2c04f9f061961baa0b54af865b2acf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.235Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-34053a006daec2bd2ab00bdb: start","job_status":"start","queue_duration_s":0.460435,"scheduling_latency_s":0.460481}2559gitlab # [ 436.132367] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"34053a006daec2bd2ab00bdb","created_at":"2026-09-06T15:44:08.216Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b2c04f9f061961baa0b54af865b2acf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.235Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-34053a006daec2bd2ab00bdb: done: 0.349426 sec","job_status":"done","queue_duration_s":0.460435,"scheduling_latency_s":0.460481,"redis_calls":11,"redis_duration_s":0.050401,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.039289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00278272,"exclusive_lock_hold_duration_s":0.0084133,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.349426,"completed_at":"2026-09-06T15:44:09.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 436.228223] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dd6fcbb1a71c1a681b743c92","created_at":"2026-09-06T15:44:08.262Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac74e648f680cd1ab1e0f57d68be389c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:44:08.280Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dd6fcbb1a71c1a681b743c92: start","job_status":"start","queue_duration_s":0.774532,"scheduling_latency_s":0.774585}2561gitlab # [ 436.246775] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.156Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2562gitlab # [ 436.311446] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dd6fcbb1a71c1a681b743c92","created_at":"2026-09-06T15:44:08.262Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac74e648f680cd1ab1e0f57d68be389c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T15:44:08.280Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dd6fcbb1a71c1a681b743c92: done: 0.171885 sec","job_status":"done","queue_duration_s":0.774532,"scheduling_latency_s":0.774585,"redis_calls":9,"redis_duration_s":0.015352000000000001,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.171885,"completed_at":"2026-09-06T15:44:09.226Z","load_balancing_strategy":"primary","db_duration_s":0.027999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2563gitlab # [ 436.396163] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6c049507f8b561e5b3e44b4e","created_at":"2026-09-06T15:44:08.315Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a06bec205f081ecf1cc4a9a6d3fabeb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.342Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6c049507f8b561e5b3e44b4e: start","job_status":"start","queue_duration_s":0.897625,"scheduling_latency_s":0.897673}2564gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2565gitlab # [ 436.497944] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6c049507f8b561e5b3e44b4e","created_at":"2026-09-06T15:44:08.315Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a06bec205f081ecf1cc4a9a6d3fabeb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.342Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6c049507f8b561e5b3e44b4e: done: 0.173521 sec","job_status":"done","queue_duration_s":0.897625,"scheduling_latency_s":0.897673,"redis_calls":9,"redis_duration_s":0.029708,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006916,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.018903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003889,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.173521,"completed_at":"2026-09-06T15:44:09.413Z","load_balancing_strategy":"primary","db_duration_s":0.029085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2566gitlab # [ 436.588980] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.418Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"9181dea6a689da0bf724c799","created_at":"2026-09-06T15:44:08.372Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"28bad5977a16f96c22aaf2d6fcfbbf66","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.387Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-9181dea6a689da0bf724c799: start","job_status":"start","queue_duration_s":1.030481,"scheduling_latency_s":1.030527}2567gitlab # [ 436.606266] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.468Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"9181dea6a689da0bf724c799","created_at":"2026-09-06T15:44:08.372Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"28bad5977a16f96c22aaf2d6fcfbbf66","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.387Z","job_size_bytes":3,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-9181dea6a689da0bf724c799: done: 0.050101 sec","job_status":"done","queue_duration_s":1.030481,"scheduling_latency_s":1.030527,"redis_calls":9,"redis_duration_s":0.0040820000000000006,"redis_read_bytes":7,"redis_write_bytes":1108,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000885,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050101,"completed_at":"2026-09-06T15:44:09.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2568gitlab # [ 436.660188] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3eb3876877971546426cb055","created_at":"2026-09-06T15:44:08.395Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1128505d21a26d029d49ad343af9a1c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.411Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3eb3876877971546426cb055: start","job_status":"start","queue_duration_s":1.059845,"scheduling_latency_s":1.059881}2569gitlab # [ 436.677235] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3eb3876877971546426cb055","created_at":"2026-09-06T15:44:08.395Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1128505d21a26d029d49ad343af9a1c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.411Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3eb3876877971546426cb055: done: 0.06194 sec","job_status":"done","queue_duration_s":1.059845,"scheduling_latency_s":1.059881,"redis_calls":11,"redis_duration_s":0.005848,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002101,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06194,"completed_at":"2026-09-06T15:44:09.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2570gitlab # [ 436.720247] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2d62a9641b0100b083324a5f","created_at":"2026-09-06T15:44:08.438Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b1e500df536862468cd745f83795519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.465Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2d62a9641b0100b083324a5f: start","job_status":"start","queue_duration_s":1.071165,"scheduling_latency_s":1.071203}2571gitlab # [ 436.734718] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2d62a9641b0100b083324a5f","created_at":"2026-09-06T15:44:08.438Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b1e500df536862468cd745f83795519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.465Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2d62a9641b0100b083324a5f: done: 0.114475 sec","job_status":"done","queue_duration_s":1.071165,"scheduling_latency_s":1.071203,"redis_calls":11,"redis_duration_s":0.003405,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008901,"exclusive_lock_hold_duration_s":0.05713982,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.114475,"completed_at":"2026-09-06T15:44:09.650Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2572gitlab # [ 436.778967] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e77c46a0e2a031c4187cb4e2","created_at":"2026-09-06T15:44:08.494Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea941dffca04d0c3bbb2a710b983fea7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.517Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e77c46a0e2a031c4187cb4e2: start","job_status":"start","queue_duration_s":1.136077,"scheduling_latency_s":1.136108}2573gitlab # [ 436.793812] gitaly[894]: time="2026-09-06T15:44:09.678Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8BTS483YP27X5CG52YDT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:39.576" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:09.677" grpc.time_ms=0.928 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2574gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.25 seconds)2575gitlab # [ 436.806496] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e77c46a0e2a031c4187cb4e2","created_at":"2026-09-06T15:44:08.494Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea941dffca04d0c3bbb2a710b983fea7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.517Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e77c46a0e2a031c4187cb4e2: done: 0.046479 sec","job_status":"done","queue_duration_s":1.136077,"scheduling_latency_s":1.136108,"redis_calls":12,"redis_duration_s":0.003083,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01349006,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.046479,"completed_at":"2026-09-06T15:44:09.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003615,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2576gitlab # [ 436.850328] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5ea794855341ed2529781693","created_at":"2026-09-06T15:44:08.538Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0adc472308396232fce1a8fdef40b2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.554Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5ea794855341ed2529781693: start","job_status":"start","queue_duration_s":1.147647,"scheduling_latency_s":1.147675}2577gitlab # [ 436.864653] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1742578gitlab # [ 437.066086] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5ea794855341ed2529781693","created_at":"2026-09-06T15:44:08.538Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0adc472308396232fce1a8fdef40b2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.554Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5ea794855341ed2529781693: done: 0.280582 sec","job_status":"done","queue_duration_s":1.147647,"scheduling_latency_s":1.147675,"redis_calls":13,"redis_duration_s":0.002985,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000776,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.215503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066184,"exclusive_lock_hold_duration_s":0.24652222,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.280582,"completed_at":"2026-09-06T15:44:09.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.071749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2579gitlab # [ 437.158342] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c956baa26e12e7ff6a2e288","created_at":"2026-09-06T15:44:08.564Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8982ae6c859f7c95b1dcb22299ef65e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.577Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c956baa26e12e7ff6a2e288: start","job_status":"start","queue_duration_s":1.406712,"scheduling_latency_s":1.406732}2580gitlab # [ 437.175515] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:09.996Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2581gitlab # [ 437.179339] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c956baa26e12e7ff6a2e288","created_at":"2026-09-06T15:44:08.564Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8982ae6c859f7c95b1dcb22299ef65e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.577Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c956baa26e12e7ff6a2e288: done: 0.021183 sec","job_status":"done","queue_duration_s":1.406712,"scheduling_latency_s":1.406732,"redis_calls":9,"redis_duration_s":0.002282,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021183,"completed_at":"2026-09-06T15:44:10.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2582gitlab # [ 437.221756] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c186d9bd08b4f475e1772dbd","created_at":"2026-09-06T15:44:08.586Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.609Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c186d9bd08b4f475e1772dbd: start","job_status":"start","queue_duration_s":1.397746,"scheduling_latency_s":1.397764}2583gitlab # [ 437.235185] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c186d9bd08b4f475e1772dbd","created_at":"2026-09-06T15:44:08.586Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.609Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c186d9bd08b4f475e1772dbd: done: 0.117196 sec","job_status":"done","queue_duration_s":1.397746,"scheduling_latency_s":1.397764,"redis_calls":70,"redis_duration_s":0.017495,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002274,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000728,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013749,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.117196,"completed_at":"2026-09-06T15:44:10.123Z","load_balancing_strategy":"primary","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2584gitlab # [ 437.278574] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1eec5906d37c29646828e861","created_at":"2026-09-06T15:44:08.640Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb97c612485140d3bc9e381aff1e7f66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:44:08.668Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1eec5906d37c29646828e861: start","job_status":"start","queue_duration_s":1.45676,"scheduling_latency_s":1.456778}2585gitlab # [ 437.291826] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1eec5906d37c29646828e861","created_at":"2026-09-06T15:44:08.640Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb97c612485140d3bc9e381aff1e7f66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T15:44:08.668Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1eec5906d37c29646828e861: done: 0.035486 sec","job_status":"done","queue_duration_s":1.45676,"scheduling_latency_s":1.456778,"redis_calls":9,"redis_duration_s":0.002331,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035486,"completed_at":"2026-09-06T15:44:10.160Z","load_balancing_strategy":"primary","db_duration_s":0.007214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2586gitlab # [ 437.333173] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"865908c01f4db4bf331ead4f","created_at":"2026-09-06T15:44:08.689Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d33df32debf59cf4631f66e455d88e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.704Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-865908c01f4db4bf331ead4f: start","job_status":"start","queue_duration_s":1.458035,"scheduling_latency_s":1.458052}2587gitlab # [ 437.346617] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"865908c01f4db4bf331ead4f","created_at":"2026-09-06T15:44:08.689Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d33df32debf59cf4631f66e455d88e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.704Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-865908c01f4db4bf331ead4f: done: 0.039461 sec","job_status":"done","queue_duration_s":1.458035,"scheduling_latency_s":1.458052,"redis_calls":18,"redis_duration_s":0.0045249999999999995,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001145,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000342,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002267,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039461,"completed_at":"2026-09-06T15:44:10.201Z","load_balancing_strategy":"primary","db_duration_s":0.003277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2588gitlab # [ 437.388758] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"344f16bcb3e2669f4cfdf3e6","created_at":"2026-09-06T15:44:08.742Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71fb4641e10dcf1193b2c4a22c35c415","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.752Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-344f16bcb3e2669f4cfdf3e6: start","job_status":"start","queue_duration_s":1.451197,"scheduling_latency_s":1.451213}2589gitlab # [ 437.402578] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"344f16bcb3e2669f4cfdf3e6","created_at":"2026-09-06T15:44:08.742Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71fb4641e10dcf1193b2c4a22c35c415","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.752Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-344f16bcb3e2669f4cfdf3e6: done: 0.037464 sec","job_status":"done","queue_duration_s":1.451197,"scheduling_latency_s":1.451213,"redis_calls":9,"redis_duration_s":0.002977,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037464,"completed_at":"2026-09-06T15:44:10.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2590gitlab # [ 437.444033] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"93c8bd40b1584ed4eb84713b","created_at":"2026-09-06T15:44:08.812Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1172c6af88432cdff4a4adf43101571b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.834Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-93c8bd40b1584ed4eb84713b: start","job_status":"start","queue_duration_s":1.408702,"scheduling_latency_s":1.408721}2591gitlab # [ 437.458224] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.260Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2592gitlab # [ 437.462012] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"93c8bd40b1584ed4eb84713b","created_at":"2026-09-06T15:44:08.812Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1172c6af88432cdff4a4adf43101571b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:08.834Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-93c8bd40b1584ed4eb84713b: done: 0.035529 sec","job_status":"done","queue_duration_s":1.408702,"scheduling_latency_s":1.408721,"redis_calls":9,"redis_duration_s":0.00247,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035529,"completed_at":"2026-09-06T15:44:10.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2593gitlab # [ 437.504585] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"19b549c908cba575e7664751","created_at":"2026-09-06T15:44:09.028Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cea10486c5dfafd7caa75d1806430093","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.052Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-19b549c908cba575e7664751: start","job_status":"start","queue_duration_s":1.229054,"scheduling_latency_s":1.229095}2594gitlab # [ 437.517930] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"19b549c908cba575e7664751","created_at":"2026-09-06T15:44:09.028Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cea10486c5dfafd7caa75d1806430093","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.052Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-19b549c908cba575e7664751: done: 0.061405 sec","job_status":"done","queue_duration_s":1.229054,"scheduling_latency_s":1.229095,"redis_calls":9,"redis_duration_s":0.0038050000000000002,"redis_read_bytes":7,"redis_write_bytes":1094,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000877,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061405,"completed_at":"2026-09-06T15:44:10.342Z","load_balancing_strategy":"primary","db_duration_s":0.00647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2595gitlab # [ 437.558607] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f2c08b11b8c1da85db96beae","created_at":"2026-09-06T15:44:09.070Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad8ec9c0fdcef3e1c96ddf15f22a4a55","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.079Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f2c08b11b8c1da85db96beae: start","job_status":"start","queue_duration_s":1.266223,"scheduling_latency_s":1.26626}2596gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2597gitlab # [ 437.927999] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f2c08b11b8c1da85db96beae","created_at":"2026-09-06T15:44:09.070Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad8ec9c0fdcef3e1c96ddf15f22a4a55","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.079Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f2c08b11b8c1da85db96beae: done: 0.49818 sec","job_status":"done","queue_duration_s":1.266223,"scheduling_latency_s":1.26626,"redis_calls":564,"redis_duration_s":0.11131400000000001,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000678,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.108895,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.429226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.49818,"completed_at":"2026-09-06T15:44:10.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2598gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.18 seconds)2599gitlab # [ 438.017998] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.850Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7f8ebafd1eeb84feea6d9ec8","created_at":"2026-09-06T15:44:09.089Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f08164925944c5acfc122343d801032a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.109Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7f8ebafd1eeb84feea6d9ec8: start","job_status":"start","queue_duration_s":1.740856,"scheduling_latency_s":1.740883}2600gitlab # [ 438.037112] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7f8ebafd1eeb84feea6d9ec8","created_at":"2026-09-06T15:44:09.089Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f08164925944c5acfc122343d801032a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.109Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7f8ebafd1eeb84feea6d9ec8: done: 0.039929 sec","job_status":"done","queue_duration_s":1.740856,"scheduling_latency_s":1.740883,"redis_calls":9,"redis_duration_s":0.013216,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003118,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039929,"completed_at":"2026-09-06T15:44:10.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2601gitlab # [ 438.090188] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1122602gitlab # [ 438.093432] gitaly[894]: time="2026-09-06T15:44:10.888Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8D1VTYGVNTKRCGG3B1NM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:40.685" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:10.886" grpc.time_ms=1.635 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2603gitlab # [ 438.107159] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fc6467944c9b067725d7a73b","created_at":"2026-09-06T15:44:09.144Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f005f72e855872d7d2ed7df54896a105","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.177Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fc6467944c9b067725d7a73b: start","job_status":"start","queue_duration_s":1.717325,"scheduling_latency_s":1.717354}2604gitlab # [ 438.122568] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.917Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2605gitlab # [ 438.126278] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.932Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fc6467944c9b067725d7a73b","created_at":"2026-09-06T15:44:09.144Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f005f72e855872d7d2ed7df54896a105","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.177Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fc6467944c9b067725d7a73b: done: 0.037433 sec","job_status":"done","queue_duration_s":1.717325,"scheduling_latency_s":1.717354,"redis_calls":9,"redis_duration_s":0.008356,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002082,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037433,"completed_at":"2026-09-06T15:44:10.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2606gitlab # [ 438.167991] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:10.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"98d85b7492571aeff3bb5836","created_at":"2026-09-06T15:44:09.222Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3013418d3112b8c478f4e0aff5c632d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.247Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-98d85b7492571aeff3bb5836: start","job_status":"start","queue_duration_s":1.687796,"scheduling_latency_s":1.687829}2607gitlab # [ 438.182203] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"98d85b7492571aeff3bb5836","created_at":"2026-09-06T15:44:09.222Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3013418d3112b8c478f4e0aff5c632d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.247Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-98d85b7492571aeff3bb5836: done: 0.070493 sec","job_status":"done","queue_duration_s":1.687796,"scheduling_latency_s":1.687829,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000889,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070528,"exclusive_lock_hold_duration_s":0.03733516,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.070493,"completed_at":"2026-09-06T15:44:11.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2608gitlab # [ 438.226522] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"596b5b29534a128cbdb9943b","created_at":"2026-09-06T15:44:09.258Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fe4ae2b1fb0a3722e1705055e1e0013","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.272Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-596b5b29534a128cbdb9943b: start","job_status":"start","queue_duration_s":1.73552,"scheduling_latency_s":1.735543}2609gitlab # [ 438.241009] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"596b5b29534a128cbdb9943b","created_at":"2026-09-06T15:44:09.258Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fe4ae2b1fb0a3722e1705055e1e0013","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.272Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-596b5b29534a128cbdb9943b: done: 0.040024 sec","job_status":"done","queue_duration_s":1.73552,"scheduling_latency_s":1.735543,"redis_calls":9,"redis_duration_s":0.00294,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000934,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040024,"completed_at":"2026-09-06T15:44:11.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2610gitlab # [ 438.282813] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"3dba22a8e66b31086538fc3e","created_at":"2026-09-06T15:44:09.300Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c0bf9ffa5df91205d71e3bd13bb2e8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.327Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-3dba22a8e66b31086538fc3e: start","job_status":"start","queue_duration_s":1.721925,"scheduling_latency_s":1.721947}2611gitlab # [ 438.298193] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"3dba22a8e66b31086538fc3e","created_at":"2026-09-06T15:44:09.300Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c0bf9ffa5df91205d71e3bd13bb2e8","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-06T15:44:09.327Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-3dba22a8e66b31086538fc3e: done: 0.053803 sec","job_status":"done","queue_duration_s":1.721925,"scheduling_latency_s":1.721947,"redis_calls":28,"redis_duration_s":0.007004,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000519,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.004025,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036586,"duration_s":0.053803,"completed_at":"2026-09-06T15:44:11.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 438.341661] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3cf1f4f7d774a350df07cff3","created_at":"2026-09-06T15:44:09.352Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5778245e894e259808f62f5e6da315a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:44:09.372Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3cf1f4f7d774a350df07cff3: start","job_status":"start","queue_duration_s":1.732338,"scheduling_latency_s":1.732356}2613gitlab # [ 438.354917] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.118Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2614gitlab # [ 438.358648] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3cf1f4f7d774a350df07cff3","created_at":"2026-09-06T15:44:09.352Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-2694400f96414667","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5778245e894e259808f62f5e6da315a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T15:44:09.372Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3cf1f4f7d774a350df07cff3: done: 0.02181 sec","job_status":"done","queue_duration_s":1.732338,"scheduling_latency_s":1.732356,"redis_calls":9,"redis_duration_s":0.002515,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02181,"completed_at":"2026-09-06T15:44:11.126Z","load_balancing_strategy":"primary","db_duration_s":0.000837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2615gitlab # [ 438.398983] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ebc739e171fa70b6f94b4a","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ebc739e171fa70b6f94b4a: start","job_status":"start","queue_duration_s":1.013607,"scheduling_latency_s":1.013624}2616gitlab # [ 438.411381] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ebc739e171fa70b6f94b4a","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ebc739e171fa70b6f94b4a: done: 0.026313 sec","job_status":"done","queue_duration_s":1.013607,"scheduling_latency_s":1.013624,"redis_calls":15,"redis_duration_s":0.003887,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002319,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026313,"completed_at":"2026-09-06T15:44:11.154Z","load_balancing_strategy":"primary","db_duration_s":0.000814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2617gitlab # [ 438.451835] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8cc363c3614de65dbcd12b7","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8cc363c3614de65dbcd12b7: start","job_status":"start","queue_duration_s":1.041426,"scheduling_latency_s":1.041443}2618gitlab # [ 438.464160] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8cc363c3614de65dbcd12b7","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8cc363c3614de65dbcd12b7: done: 0.01964 sec","job_status":"done","queue_duration_s":1.041426,"scheduling_latency_s":1.041443,"redis_calls":13,"redis_duration_s":0.003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01964,"completed_at":"2026-09-06T15:44:11.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2619gitlab # [ 438.502958] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bc3e30748e4c63b1c0a34e9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bc3e30748e4c63b1c0a34e9: start","job_status":"start","queue_duration_s":1.062633,"scheduling_latency_s":1.062652}2620gitlab # [ 438.515252] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bc3e30748e4c63b1c0a34e9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bc3e30748e4c63b1c0a34e9: done: 0.017343 sec","job_status":"done","queue_duration_s":1.062633,"scheduling_latency_s":1.062652,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017343,"completed_at":"2026-09-06T15:44:11.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2621gitlab # [ 438.554593] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53a4f189e4811d098e8fb2c1","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53a4f189e4811d098e8fb2c1: start","job_status":"start","queue_duration_s":1.081524,"scheduling_latency_s":1.081542}2622gitlab # [ 438.567284] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53a4f189e4811d098e8fb2c1","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53a4f189e4811d098e8fb2c1: done: 0.016846 sec","job_status":"done","queue_duration_s":1.081524,"scheduling_latency_s":1.081542,"redis_calls":13,"redis_duration_s":0.002584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016846,"completed_at":"2026-09-06T15:44:11.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2623gitlab # [ 438.606863] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a04a5a43f72cc0a1f9bc57b","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a04a5a43f72cc0a1f9bc57b: start","job_status":"start","queue_duration_s":1.099996,"scheduling_latency_s":1.100014}2624gitlab # [ 438.619633] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a04a5a43f72cc0a1f9bc57b","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a04a5a43f72cc0a1f9bc57b: done: 0.030904 sec","job_status":"done","queue_duration_s":1.099996,"scheduling_latency_s":1.100014,"redis_calls":13,"redis_duration_s":0.006328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030904,"completed_at":"2026-09-06T15:44:11.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2625gitlab # [ 438.658749] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad38aa99336ff7fa0a76a573","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad38aa99336ff7fa0a76a573: start","job_status":"start","queue_duration_s":1.134909,"scheduling_latency_s":1.13495}2626gitlab # [ 438.671239] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad38aa99336ff7fa0a76a573","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad38aa99336ff7fa0a76a573: done: 0.052218 sec","job_status":"done","queue_duration_s":1.134909,"scheduling_latency_s":1.13495,"redis_calls":13,"redis_duration_s":0.011805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007228,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052218,"completed_at":"2026-09-06T15:44:11.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2627gitlab # [ 438.711634] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0683121b272cba13037c5c03","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0683121b272cba13037c5c03: start","job_status":"start","queue_duration_s":1.191965,"scheduling_latency_s":1.192013}2628gitlab # [ 438.724447] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0683121b272cba13037c5c03","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0683121b272cba13037c5c03: done: 0.04175 sec","job_status":"done","queue_duration_s":1.191965,"scheduling_latency_s":1.192013,"redis_calls":13,"redis_duration_s":0.005216999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002237,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00298,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04175,"completed_at":"2026-09-06T15:44:11.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2629gitlab # [ 438.763973] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c94c3f5bcc20cab8f2cc3b21","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c94c3f5bcc20cab8f2cc3b21: start","job_status":"start","queue_duration_s":1.236859,"scheduling_latency_s":1.236898}2630gitlab # [ 438.776840] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c94c3f5bcc20cab8f2cc3b21","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c94c3f5bcc20cab8f2cc3b21: done: 0.028271 sec","job_status":"done","queue_duration_s":1.236859,"scheduling_latency_s":1.236898,"redis_calls":13,"redis_duration_s":0.0032890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028271,"completed_at":"2026-09-06T15:44:11.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2631gitlab # [ 438.816761] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3593136a01dc11ba7fca20","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3593136a01dc11ba7fca20: start","job_status":"start","queue_duration_s":1.267608,"scheduling_latency_s":1.267643}2632gitlab # [ 438.829424] nix-daemon[3767]: accepted connection from pid 4456, user nixbot2633gitlab # [ 438.830468] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3593136a01dc11ba7fca20","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3593136a01dc11ba7fca20: done: 0.022666 sec","job_status":"done","queue_duration_s":1.267608,"scheduling_latency_s":1.267643,"redis_calls":13,"redis_duration_s":0.003139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022666,"completed_at":"2026-09-06T15:44:11.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2634gitlab # [ 438.869201] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8518f0adc206dffe55e5334d","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8518f0adc206dffe55e5334d: start","job_status":"start","queue_duration_s":1.292571,"scheduling_latency_s":1.292601}2635gitlab # [ 438.881446] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8518f0adc206dffe55e5334d","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8518f0adc206dffe55e5334d: done: 0.021081 sec","job_status":"done","queue_duration_s":1.292571,"scheduling_latency_s":1.292601,"redis_calls":13,"redis_duration_s":0.0033280000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021081,"completed_at":"2026-09-06T15:44:11.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2636gitlab # [ 438.921417] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca6a7040901254917e6032a7","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca6a7040901254917e6032a7: start","job_status":"start","queue_duration_s":1.315803,"scheduling_latency_s":1.315847}2637gitlab # [ 438.934168] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca6a7040901254917e6032a7","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca6a7040901254917e6032a7: done: 0.020363 sec","job_status":"done","queue_duration_s":1.315803,"scheduling_latency_s":1.315847,"redis_calls":13,"redis_duration_s":0.002911,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020363,"completed_at":"2026-09-06T15:44:11.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2638gitlab # [ 438.973087] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a53f37b3ca13356fa40e3c","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a53f37b3ca13356fa40e3c: start","job_status":"start","queue_duration_s":1.337761,"scheduling_latency_s":1.337789}2639gitlab # [ 438.985478] gitaly[894]: time="2026-09-06T15:44:11.820Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:41.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:11.818" grpc.time_ms=1.276 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2640gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2641gitlab # [ 438.998199] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a53f37b3ca13356fa40e3c","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a53f37b3ca13356fa40e3c: done: 0.020181 sec","job_status":"done","queue_duration_s":1.337761,"scheduling_latency_s":1.337789,"redis_calls":13,"redis_duration_s":0.003391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002451,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020181,"completed_at":"2026-09-06T15:44:11.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2642gitlab # [ 439.035894] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1835ead88069b6d15fe266b9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1835ead88069b6d15fe266b9: start","job_status":"start","queue_duration_s":1.359379,"scheduling_latency_s":1.359397}2643gitlab # [ 439.047425] gitaly[894]: time="2026-09-06T15:44:11.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:21.174" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:11.864" grpc.time_ms=10.92 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2644gitlab # [ 439.059864] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1835ead88069b6d15fe266b9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1835ead88069b6d15fe266b9: done: 0.018212 sec","job_status":"done","queue_duration_s":1.359379,"scheduling_latency_s":1.359397,"redis_calls":13,"redis_duration_s":0.003241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018212,"completed_at":"2026-09-06T15:44:11.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2645gitlab # [ 439.102656] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4928a09d19a037b8f8a7a91d","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4928a09d19a037b8f8a7a91d: start","job_status":"start","queue_duration_s":1.379111,"scheduling_latency_s":1.379129}2646gitlab # [ 439.115164] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4928a09d19a037b8f8a7a91d","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4928a09d19a037b8f8a7a91d: done: 0.018373 sec","job_status":"done","queue_duration_s":1.379111,"scheduling_latency_s":1.379129,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018373,"completed_at":"2026-09-06T15:44:11.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2647gitlab # [ 439.154018] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ced0e42316583fa0d8e77f2","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ced0e42316583fa0d8e77f2: start","job_status":"start","queue_duration_s":1.399038,"scheduling_latency_s":1.399056}2648gitlab # [ 439.166754] nixbot[3536]: {"ts": "2026-09-06T15:44:11.982Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 \"HTTP/1.1 201 Created\""}2649gitlab # [ 439.170011] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2252650gitlab # [ 439.172827] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ced0e42316583fa0d8e77f2","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ced0e42316583fa0d8e77f2: done: 0.019862 sec","job_status":"done","queue_duration_s":1.399038,"scheduling_latency_s":1.399056,"redis_calls":13,"redis_duration_s":0.003368,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002418,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019862,"completed_at":"2026-09-06T15:44:11.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2651gitlab # [ 439.211268] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b99ab436d3276aa8438a6f","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b99ab436d3276aa8438a6f: start","job_status":"start","queue_duration_s":1.42048,"scheduling_latency_s":1.420498}2652gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.21 seconds)2653gitlab # [ 439.224780] gitaly[894]: time="2026-09-06T15:44:12.078Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8E6M46RJNMPWAST81BV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:42.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:12.077" grpc.time_ms=0.847 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2654gitlab # [ 439.236976] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 902655gitlab # [ 439.239721] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b99ab436d3276aa8438a6f","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b99ab436d3276aa8438a6f: done: 0.017932 sec","job_status":"done","queue_duration_s":1.42048,"scheduling_latency_s":1.420498,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017932,"completed_at":"2026-09-06T15:44:11.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2656gitlab # [ 439.279482] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4226b2414e0a9a0135c82be","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4226b2414e0a9a0135c82be: start","job_status":"start","queue_duration_s":1.440404,"scheduling_latency_s":1.440423}2657gitlab # [ 439.292267] gitaly[894]: time="2026-09-06T15:44:12.105Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8E8EYCN6XBP2BF67T72N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:42.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:12.104" grpc.time_ms=0.729 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2658gitlab # [ 439.306044] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4226b2414e0a9a0135c82be","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4226b2414e0a9a0135c82be: done: 0.018748 sec","job_status":"done","queue_duration_s":1.440404,"scheduling_latency_s":1.440423,"redis_calls":13,"redis_duration_s":0.0029709999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018748,"completed_at":"2026-09-06T15:44:11.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2659gitlab # [ 439.345842] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31b17c12bafd68961f685b3","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31b17c12bafd68961f685b3: start","job_status":"start","queue_duration_s":1.461449,"scheduling_latency_s":1.461468}2660gitlab # [ 439.358282] gitaly[894]: time="2026-09-06T15:44:12.170Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP8E6M46RJNMPWAST81BV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:22.161" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.162" grpc.time_ms=8.104 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2661gitlab # [ 439.371772] nixbot[3536]: {"ts": "2026-09-06T15:44:12.226Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 \"HTTP/1.1 201 Created\""}2662gitlab # [ 439.374721] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2362663gitlab # [ 439.377298] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31b17c12bafd68961f685b3","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31b17c12bafd68961f685b3: done: 0.018708 sec","job_status":"done","queue_duration_s":1.461449,"scheduling_latency_s":1.461468,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018708,"completed_at":"2026-09-06T15:44:11.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2664gitlab # [ 439.416492] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26c4a4cef3568bb23af5f14","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26c4a4cef3568bb23af5f14: start","job_status":"start","queue_duration_s":1.482207,"scheduling_latency_s":1.482227}2665gitlab # [ 439.428568] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26c4a4cef3568bb23af5f14","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26c4a4cef3568bb23af5f14: done: 0.018296 sec","job_status":"done","queue_duration_s":1.482207,"scheduling_latency_s":1.482227,"redis_calls":13,"redis_duration_s":0.003096,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018296,"completed_at":"2026-09-06T15:44:11.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2666gitlab # [ 439.467660] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9753c45f228bc23c43ed64d1","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9753c45f228bc23c43ed64d1: start","job_status":"start","queue_duration_s":1.502109,"scheduling_latency_s":1.502127}2667gitlab # [ 439.480157] gitaly[894]: time="2026-09-06T15:44:12.303Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8EECDHS93AEW25Y2YJYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:42.201" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:12.301" grpc.time_ms=0.993 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2668gitlab # [ 439.493052] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9753c45f228bc23c43ed64d1","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9753c45f228bc23c43ed64d1: done: 0.016353 sec","job_status":"done","queue_duration_s":1.502109,"scheduling_latency_s":1.502127,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016353,"completed_at":"2026-09-06T15:44:11.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2669gitlab # [ 439.532413] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2afb7bbf49dfaf0b91e769d5","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2afb7bbf49dfaf0b91e769d5: start","job_status":"start","queue_duration_s":1.519885,"scheduling_latency_s":1.519902}2670gitlab # [ 439.544389] nixbot[3536]: {"ts": "2026-09-06T15:44:12.398Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 \"HTTP/1.1 201 Created\""}2671gitlab # [ 439.547047] gitaly[894]: time="2026-09-06T15:44:12.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1VP8EECDHS93AEW25Y2YJYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T15:44:22.121" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.341" grpc.time_ms=9.806 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2672gitlab # [ 439.560363] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/631e5202beb049dde21ed2d10f9e5159f2411c94 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1592673gitlab # [ 439.562834] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2afb7bbf49dfaf0b91e769d5","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2afb7bbf49dfaf0b91e769d5: done: 0.015755 sec","job_status":"done","queue_duration_s":1.519885,"scheduling_latency_s":1.519902,"redis_calls":13,"redis_duration_s":0.0024609999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001553,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015755,"completed_at":"2026-09-06T15:44:11.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2674gitlab # [ 439.601491] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14735bdecd69e1423100da0b","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14735bdecd69e1423100da0b: start","job_status":"start","queue_duration_s":1.537127,"scheduling_latency_s":1.537144}2675gitlab # [ 439.613645] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14735bdecd69e1423100da0b","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14735bdecd69e1423100da0b: done: 0.016132 sec","job_status":"done","queue_duration_s":1.537127,"scheduling_latency_s":1.537144,"redis_calls":13,"redis_duration_s":0.002834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016132,"completed_at":"2026-09-06T15:44:11.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2676gitlab # [ 439.651903] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3083e29f6afa0850d924481","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3083e29f6afa0850d924481: start","job_status":"start","queue_duration_s":1.554875,"scheduling_latency_s":1.554891}2677gitlab # [ 439.664169] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3083e29f6afa0850d924481","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3083e29f6afa0850d924481: done: 0.074789 sec","job_status":"done","queue_duration_s":1.554875,"scheduling_latency_s":1.554891,"redis_calls":13,"redis_duration_s":0.02135,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.074789,"completed_at":"2026-09-06T15:44:11.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2678gitlab # [ 439.702604] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95548cfe2c3ce024674d7764","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95548cfe2c3ce024674d7764: start","job_status":"start","queue_duration_s":1.634191,"scheduling_latency_s":1.634243}2679gitlab # [ 439.714839] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95548cfe2c3ce024674d7764","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95548cfe2c3ce024674d7764: done: 0.036577 sec","job_status":"done","queue_duration_s":1.634191,"scheduling_latency_s":1.634243,"redis_calls":13,"redis_duration_s":0.003975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002643,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036577,"completed_at":"2026-09-06T15:44:11.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2680gitlab # [ 439.754380] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1bbdd51bca128a9fe57c0e","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1bbdd51bca128a9fe57c0e: start","job_status":"start","queue_duration_s":1.672835,"scheduling_latency_s":1.672865}2681gitlab # [ 439.766641] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1bbdd51bca128a9fe57c0e","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1bbdd51bca128a9fe57c0e: done: 0.027436 sec","job_status":"done","queue_duration_s":1.672835,"scheduling_latency_s":1.672865,"redis_calls":13,"redis_duration_s":0.00372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002499,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027436,"completed_at":"2026-09-06T15:44:11.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2682gitlab # [ 439.805069] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1839cad6ffe5a350014ce6ca","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1839cad6ffe5a350014ce6ca: start","job_status":"start","queue_duration_s":1.705632,"scheduling_latency_s":1.705669}2683gitlab # [ 439.817071] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1839cad6ffe5a350014ce6ca","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1839cad6ffe5a350014ce6ca: done: 0.031504 sec","job_status":"done","queue_duration_s":1.705632,"scheduling_latency_s":1.705669,"redis_calls":13,"redis_duration_s":0.0041589999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031504,"completed_at":"2026-09-06T15:44:11.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2684gitlab # [ 439.856190] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c7fe20810fe0e2a5f11659","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c7fe20810fe0e2a5f11659: start","job_status":"start","queue_duration_s":1.739485,"scheduling_latency_s":1.739521}2685gitlab # [ 439.868324] gitaly[894]: time="2026-09-06T15:44:12.703Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:12.699" grpc.time_ms=1.6 pid=894 span.kind=server system=grpc2686gitlab # [ 439.878180] gitaly[894]: time="2026-09-06T15:44:12.748Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:12.748" grpc.time_ms=0.554 pid=894 span.kind=server system=grpc2687gitlab # [ 439.887653] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c7fe20810fe0e2a5f11659","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c7fe20810fe0e2a5f11659: done: 0.027013 sec","job_status":"done","queue_duration_s":1.739485,"scheduling_latency_s":1.739521,"redis_calls":13,"redis_duration_s":0.00263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027013,"completed_at":"2026-09-06T15:44:11.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2688gitlab # [ 439.927570] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edc225951cbe1771e84266b5","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edc225951cbe1771e84266b5: start","job_status":"start","queue_duration_s":1.768217,"scheduling_latency_s":1.768247}2689gitlab # [ 439.939789] gitaly[894]: time="2026-09-06T15:44:12.778Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T15:44:12.777" grpc.time_ms=0.717 pid=894 span.kind=server system=grpc2690gitlab # [ 439.949503] gitaly[894]: time="2026-09-06T15:44:12.782Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" operations="[repack_refs]" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2691gitlab # [ 439.959092] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edc225951cbe1771e84266b5","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edc225951cbe1771e84266b5: done: 0.019685 sec","job_status":"done","queue_duration_s":1.768217,"scheduling_latency_s":1.768247,"redis_calls":13,"redis_duration_s":0.002001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019685,"completed_at":"2026-09-06T15:44:11.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2692gitlab # [ 439.998681] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78a2b19f144ee75c53d442f9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78a2b19f144ee75c53d442f9: start","job_status":"start","queue_duration_s":1.789147,"scheduling_latency_s":1.789171}2693gitlab # [ 440.011418] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862694gitlab # [ 440.013682] gitaly[894]: time="2026-09-06T15:44:12.785Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" pid=894 remote_ip="2001:db8:1::1" repository_info="{false {6 701 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-06 15:42:18.53477638 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2695gitlab # [ 440.025830] gitaly[894]: time="2026-09-06T15:44:12.790Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P diskcache=27fb2a70-b210-4ade-a7ab-13210805e363 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2696gitlab # [ 440.035661] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78a2b19f144ee75c53d442f9","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78a2b19f144ee75c53d442f9: done: 0.021981 sec","job_status":"done","queue_duration_s":1.789147,"scheduling_latency_s":1.789171,"redis_calls":13,"redis_duration_s":0.00732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021981,"completed_at":"2026-09-06T15:44:11.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2697gitlab # [ 440.075377] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23f4fbd3cfbe33c044d12b6f","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23f4fbd3cfbe33c044d12b6f: start","job_status":"start","queue_duration_s":1.812731,"scheduling_latency_s":1.812758}2698gitlab # [ 440.087969] gitaly[894]: time="2026-09-06T15:44:12.791Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7495 command.oublock=0 command.real_time_ms=116 command.spawn_token_fork_ms=3 command.system_time_ms=58 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" grpc.time_ms=126.108 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2699gitlab # [ 440.101465] gitlab-workhorse[821]: time="2026-09-06T15:44:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672700gitlab # [ 440.103296] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722701gitlab # [ 440.105283] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23f4fbd3cfbe33c044d12b6f","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23f4fbd3cfbe33c044d12b6f: done: 0.017157 sec","job_status":"done","queue_duration_s":1.812731,"scheduling_latency_s":1.812758,"redis_calls":13,"redis_duration_s":0.001881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017157,"completed_at":"2026-09-06T15:44:11.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2702gitlab # [ 440.145963] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f38420f25b72bff3bc8da91","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f38420f25b72bff3bc8da91: start","job_status":"start","queue_duration_s":1.83123,"scheduling_latency_s":1.831255}2703gitlab # [ 440.158575] gitaly[894]: time="2026-09-06T15:44:12.810Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" pid=894 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2704gitlab # [ 440.171962] gitaly[894]: time="2026-09-06T15:44:12.811Z" level=info msg="optimized repository" clean_stale_data_time=24.36224ms clean_work_trees_time="84.6µs" commit_graph_time=500ns correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.4µs" pid=894 prune_time=160ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.22µs" storage_name=default system=housekeeping total_time=24.48286ms2705gitlab # [ 440.178388] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 682706gitlab # [ 440.180783] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f38420f25b72bff3bc8da91","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f38420f25b72bff3bc8da91: done: 0.019836 sec","job_status":"done","queue_duration_s":1.83123,"scheduling_latency_s":1.831255,"redis_calls":13,"redis_duration_s":0.002271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019836,"completed_at":"2026-09-06T15:44:11.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2707gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses2708gitlab # [ 440.220485] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921b06340c73e1c9bc95f8f0","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921b06340c73e1c9bc95f8f0: start","job_status":"start","queue_duration_s":1.8526,"scheduling_latency_s":1.852624}2709gitlab # [ 440.233152] gitaly[894]: time="2026-09-06T15:44:12.811Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T15:44:42.564" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T15:44:12.664" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2710gitlab # [ 440.241726] gitaly[894]: time="2026-09-06T15:44:12.869Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T15:44:42.766" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:12.867" grpc.time_ms=1.591 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2711gitlab # [ 440.253475] gitlab-workhorse[821]: time="2026-09-06T15:44:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672712gitlab # [ 440.255157] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/06:15:44:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722713gitlab # [ 440.256971] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921b06340c73e1c9bc95f8f0","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921b06340c73e1c9bc95f8f0: done: 0.020126 sec","job_status":"done","queue_duration_s":1.8526,"scheduling_latency_s":1.852624,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020126,"completed_at":"2026-09-06T15:44:11.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2714gitlab # [ 440.294924] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:11.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"107530c4b6c9633088d52d06","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-107530c4b6c9633088d52d06: start","job_status":"start","queue_duration_s":1.874198,"scheduling_latency_s":1.874224}2715gitlab # [ 440.307562] gitaly[894]: time="2026-09-06T15:44:12.872Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1VP8EZJKWFQVV1V0H4PWE3N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:12.860" grpc.time_ms=11.403 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2716gitlab # [ 440.320950] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:12.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"107530c4b6c9633088d52d06","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-107530c4b6c9633088d52d06: done: 0.017537 sec","job_status":"done","queue_duration_s":1.874198,"scheduling_latency_s":1.874224,"redis_calls":13,"redis_duration_s":0.001873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001158,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017537,"completed_at":"2026-09-06T15:44:12.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2717gitlab # [ 440.360936] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:12.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e2990920880b1dfffdc4458","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e2990920880b1dfffdc4458: start","job_status":"start","queue_duration_s":1.893578,"scheduling_latency_s":1.893605}2718gitlab # [ 440.373480] gitaly[894]: time="2026-09-06T15:44:12.910Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8DZCT9N8VWQ0VCCC9G5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T15:44:42.809" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T15:44:12.909" grpc.time_ms=1.123 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2719gitlab # [ 440.385993] gitaly[894]: time="2026-09-06T15:44:12.945Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8F2AGPVYMQFB5SYKADSA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:12.935" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2720gitlab # [ 440.396210] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:12.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e2990920880b1dfffdc4458","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e2990920880b1dfffdc4458: done: 0.019639 sec","job_status":"done","queue_duration_s":1.893578,"scheduling_latency_s":1.893605,"redis_calls":13,"redis_duration_s":0.0021980000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019639,"completed_at":"2026-09-06T15:44:12.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2721gitlab # [ 440.435384] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:12.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f89d774681762d73c8ef1c3e","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f89d774681762d73c8ef1c3e: start","job_status":"start","queue_duration_s":1.914679,"scheduling_latency_s":1.914704}2722gitlab # [ 440.447994] gitaly[894]: time="2026-09-06T15:44:12.945Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1VP8F2AGPVYMQFB5SYKADSA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T15:44:12.935" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2723gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/631e5202beb049dde21ed2d10f9e5159f2411c94/statuses, in 0.23 seconds)2724(finished: subtest: eval and build post commit statuses, in 11.16 seconds)2725(finished: run the VM test script, in 513.74 seconds)2726test script finished in 513.77s2727cleanup2728kill QemuMachine (pid 46)2729gitlab # [ 440.461286] sidekiq-cluster[3428]: {"severity":"INFO","time":"2026-09-06T15:44:12.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f89d774681762d73c8ef1c3e","created_at":"2026-09-06T15:44:10.027Z","trace_propagation_headers":{"sentry-trace":"d87dce9b984e4d81a62191b95bea5d74-e2097a8ad37346a5","baggage":"sentry-trace_id=d87dce9b984e4d81a62191b95bea5d74,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"53a4d2ef5ef3e38e0bf1b6ae21b995a6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T15:44:10.114Z","job_size_bytes":2,"pid":3428,"sidekiq_tid":"m8lo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f89d774681762d73c8ef1c3e: done: 0.020068 sec","job_status":"done","queue_duration_s":1.914679,"scheduling_latency_s":1.914704,"redis_calls":13,"redis_duration_s":0.002082,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duratioqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2730gitlab # n2731(finished: cleanup, in 1.66 seconds)2732additionally exposed symbols:2733 gitlab,2734 vlan1,2735 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2736[]2737[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-06T15:42:27.669Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2738[]2739[]2740[]2741[]2742[]2743[]2744[]2745[]2746[]2747[]2748[]2749[]2750[]2751[]2752[]2753[]2754[]2755[]2756[]2757[]2758[]2759[]2760[]2761[]2762[]2763[]2764[]2765[]2766[]2767[]2768[]2769[]2770[]2771[]2772[]2773[]2774[]2775[]2776[]2777[]2778[]2779[]2780[]2781[]2782[]2783[]2784[]2785[]2786[]2787[]2788[]2789[]2790[]2791[]2792[]2793[]2794[]2795[]2796[]2797[]2798[]2799[]2800[]2801[]2802[]2803[]2804[]2805[]2806[]2807[]2808[]2809[]2810[]2811[]2812[]2813[]2814[]2815[]2816[]2817[]2818[]2819[]2820[]2821[]2822[]2823[]2824[]2825[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-06T15:44:01.372147Z', 'started_at': '2026-09-06T15:44:01.770416Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2826[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2827[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2828[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2829[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2830[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2831[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2832[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2833[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2834[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': '2026-09-06T15:44:11.927Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2835[{'id': 5, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-06T15:44:01.731Z', 'started_at': None, 'finished_at': '2026-09-06T15:44:11.927Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '631e5202beb049dde21ed2d10f9e5159f2411c94', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-06T15:44:12.196Z', 'started_at': None, 'finished_at': '2026-09-06T15:44:12.374Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]