vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #227
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.aayMU9HhWt', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: fd5358cf-10c8-4293-a2a6-cb572cb57d4f16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618(finished: start all VMs, in 67.89 seconds)19gitlab # 20gitlab: waiting for unit setup-gitlab.service21gitlab # Allocating group tables: 0/8 done22gitlab: waiting for the VM to finish booting23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hbqglm4gifs1s46zqxmbp5d9qkpi1ang-nixos-system-gitlab-test/init regInfo=/nix/store/qs5dp83ds2bmyksd74hdggx4xl3yhdj4-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qs5dp83ds2bmyksd74hdggx4xl3yhdj4-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000415] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000617] Console: colour dummy device 80x25110gitlab # [ 0.000624] printk: legacy console [tty0] enabled111gitlab # [ 0.000812] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000819] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000898] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001041] landlock: Up and running.115gitlab # [ 0.001044] Yama: becoming mindful.116gitlab # [ 0.001474] LSM support for eBPF active117gitlab # [ 0.001647] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001752] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002911] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003565] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003569] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003720] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004700] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004791] EFI services will not be available.125gitlab # [ 0.004954] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005647] Detected PIPT I-cache on CPU1127gitlab # [ 0.005747] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005868] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000129gitlab # [ 0.005991] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007057] Detected PIPT I-cache on CPU2131gitlab # [ 0.007163] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007285] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000133gitlab # [ 0.007411] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008497] Detected PIPT I-cache on CPU3135gitlab # [ 0.008609] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008729] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000137gitlab # [ 0.008853] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009346] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009371] SMP: Total of 4 processors activated.140gitlab # [ 0.009374] CPU: All CPU(s) started at EL1141gitlab # [ 0.009383] CPU features: detected: Branch Target Identification142gitlab # [ 0.009387] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009390] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009393] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009396] CPU features: detected: Common not Private translations146gitlab # [ 0.009399] CPU features: detected: CRC32 instructions147gitlab # [ 0.009401] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009405] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009408] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009410] CPU features: detected: E0PD151gitlab # [ 0.009413] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009415] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009418] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009421] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009424] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009428] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009430] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009433] CPU features: detected: Privileged Access Never159gitlab # [ 0.009435] CPU features: detected: PMUv3160gitlab # [ 0.009438] CPU features: detected: RAS Extension Support161gitlab # [ 0.009440] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009442] CPU features: detected: Random Number Generator163gitlab # [ 0.009445] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009447] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009450] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009453] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009582] alternatives: applying system-wide alternatives168gitlab # [ 0.012498] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012718] Memory: 5963728K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014190] devtmpfs: initialized171gitlab # [ 0.018126] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018193] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018394] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018398] 0 pages in range for non-PLT usage175gitlab # [ 0.018399] 508288 pages in range for PLT usage176gitlab # [ 0.018521] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019339] DMI not present or invalid.178gitlab # [ 0.022438] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024907] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025182] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026883] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026904] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027274] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027713] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027715] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027720] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027723] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027725] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027807] cpuidle: using governor ladder190gitlab # [ 0.027831] cpuidle: using governor menu191gitlab # [ 0.028053] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028259] ASID allocator initialised with 65536 entries193gitlab # [ 0.029407] Serial: AMBA PL011 UART driver194gitlab # [ 0.034350] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034667] printk: console [ttyAMA0] enabled196gitlab # [ 0.046419] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.046426] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.046430] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.046432] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.046435] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.046438] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.046441] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.046443] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059380] fbcon: Taking over console205gitlab # [ 0.059413] ACPI: Interpreter disabled.206gitlab # [ 0.062049] iommu: Default domain type: Translated207gitlab # [ 0.062058] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.077580] SCSI subsystem initialized209gitlab # [ 0.078378] usbcore: registered new interface driver usbfs210gitlab # [ 0.078484] usbcore: registered new interface driver hub211gitlab # [ 0.078553] usbcore: registered new device driver usb212gitlab # [ 0.079310] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.079319] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.079377] PTP clock support registered215gitlab # [ 0.079499] EDAC MC: Ver: 3.0.0216gitlab # [ 0.079934] scmi_core: SCMI protocol bus registered217gitlab # [ 0.080831] FPGA manager framework218gitlab # [ 0.083205] vgaarb: loaded219gitlab # [ 0.085337] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.085903] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.085936] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.089433] netfs: FS-Cache loaded223gitlab # [ 0.089624] pnp: PnP ACPI: disabled224gitlab # [ 0.097208] NET: Registered PF_INET protocol family225gitlab # [ 0.098486] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.133714] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.133768] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.133815] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.134099] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.134729] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.134827] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.134882] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.135009] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.135215] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.135233] NET: Registered PF_XDP protocol family236gitlab # [ 0.135249] PCI: CLS 0 bytes, default 64237gitlab # [ 0.135666] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.154612] kvm [1]: HYP mode not available239gitlab # [ 0.209586] Initialise system trusted keyrings240gitlab # [ 0.209988] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.210812] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.210954] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.224088] Key type asymmetric registered244gitlab # [ 0.224093] Asymmetric key parser 'x509' registered245gitlab # [ 0.224154] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.224344] io scheduler mq-deadline registered247gitlab # [ 0.224349] io scheduler kyber registered248gitlab # [ 0.229956] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.237675] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.239034] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.239073] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.239106] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.239124] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.239163] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.239221] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.239583] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.239602] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.239624] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.239635] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.239644] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.239940] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.241458] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.242113] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.242149] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.242229] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.242266] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.243798] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.244470] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.244505] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.244598] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.246130] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.246815] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.246850] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.246930] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.248428] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.249095] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.249130] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.249211] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.250828] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.251513] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.251548] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.251628] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.253141] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.253829] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.253864] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.253945] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.255522] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.256156] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.256192] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.256284] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.256320] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.257991] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.258667] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.258746] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.260264] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.260919] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.261011] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.262365] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.263016] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.263775] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.264506] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.264542] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.264623] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.266161] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.266807] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.266842] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.266933] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.268746] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.268764] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.268776] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.268906] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.269036] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.269170] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.269300] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.269486] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.269619] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.269753] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.269887] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.270021] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.270206] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.270337] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.270393] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.270447] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.270499] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.270553] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.270607] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.270661] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.270716] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.270771] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.270826] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.270885] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.270941] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.270994] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.271046] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.271102] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.271154] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.271223] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.271277] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.271331] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.271397] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.271451] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.271516] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.271532] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.271541] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.275415] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.310039] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.314862] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.319729] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.325841] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.330357] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.335987] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.341718] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.346485] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.352451] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.356739] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.362455] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.375009] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.378761] msm_serial: driver initialized359gitlab # [ 0.379057] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.379166] STM32 USART driver initialized361gitlab # [ 0.420906] loop: module loaded362gitlab # [ 0.421244] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.424833] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.428149] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.431403] virtio_blk virtio5: [vdb] 12227504 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.435037] megasas: 07.734.00.00-rc1367gitlab # [ 0.436466] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.439767] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.439791] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.442722] Using buffer write method371gitlab # [ 0.442806] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.446287] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.446312] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.450427] Using buffer write method375gitlab # [ 0.450449] Concatenating MTD devices:376gitlab # [ 0.450453] (0): "0.flash"377gitlab # [ 0.450458] (1): "0.flash"378gitlab # [ 0.450461] into device "0.flash"379gitlab # [ 0.576428] Freeing initrd memory: 27184K380gitlab # [ 0.595063] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.603643] thunder_xcv, ver 1.0382gitlab # [ 0.603765] thunder_bgx, ver 1.0383gitlab # [ 0.603824] nicpf, ver 1.0384gitlab # [ 0.605657] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.605671] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.605734] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.605748] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.605835] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.605845] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.605903] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.605913] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.606308] sky2: driver version 1.30393gitlab # [ 0.611027] usbcore: registered new interface driver usb-storage394gitlab # [ 0.611369] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.611445] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.611483] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.611531] usbserial: USB Serial support registered for generic398gitlab # [ 0.612046] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.613509] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.615917] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.615973] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T12:31:01 UTC (1786883461)402gitlab # [ 0.616865] i2c_dev: i2c /dev entries driver403gitlab # [ 0.621435] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.622669] hub 1-0:1.0: USB hub found405gitlab # [ 0.622754] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.624832] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.624845] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.625699] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.626853] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.631626] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.632591] usbcore: registered new interface driver usbhid412gitlab # [ 0.632603] usbhid: USB HID core driver413gitlab # [ 0.659506] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.664371] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.664768] NET: Registered PF_INET6 protocol family416gitlab # [ 0.666574] Segment Routing with IPv6417gitlab # [ 0.666610] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.666675] NET: Registered PF_PACKET protocol family419gitlab # [ 0.666984] 9pnet: Installing 9P2000 support420gitlab # [ 0.671436] Key type dns_resolver registered421gitlab # [ 0.690710] registered taskstats version 1422gitlab # [ 0.691358] Loading compiled-in X.509 certificates423gitlab # [ 0.717912] Demotion targets for Node 0: null424gitlab # [ 0.718179] Key type .fscrypt registered425gitlab # [ 0.718188] Key type fscrypt-provisioning registered426gitlab # [ 0.718371] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.718397] ima: Allocated hash algorithm: sha1428gitlab # [ 0.718444] ima: No architecture policies found429gitlab # [ 0.719856] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.759307] clk: Disabling unused clocks431gitlab # [ 0.759352] PM: genpd: Disabling unused power domains432gitlab # [ 0.767926] Freeing unused kernel memory: 4736K433gitlab # [ 0.768248] Run /init as init process434gitlab # [ 0.808373] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.869423] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.023975] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.114016] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.143161] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.143231] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.143303] systemd[1]: Detected architecture arm64.441gitlab # [ 1.143320] systemd[1]: Running in initrd.442gitlab # [ 1.144129] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.144559] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.245415] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.395667] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.396183] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.397767] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.506847] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.527052] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.527623] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.527694] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.527722] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.527777] systemd[1]: Reached target Path Units.454gitlab # [ 1.527815] systemd[1]: Reached target Slice Units.455gitlab # [ 1.527852] systemd[1]: Reached target Swaps.456gitlab # [ 1.527890] systemd[1]: Reached target Timer Units.457gitlab # [ 1.528282] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.528723] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.529052] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.529418] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.529609] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.529653] systemd[1]: Reached target Socket Units.463gitlab # [ 1.532838] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.536069] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.536202] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.539587] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.570363] systemd[1]: Starting Journal Service...468gitlab # [ 1.573856] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.574116] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.577626] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.585397] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.587928] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.588867] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.594275] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.601611] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.622992] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.624565] systemd-journald[94]: Collecting audit messages is disabled.478gitlab # [ 1.627637] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev479gitlab # [ 1.632178] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.632459] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 1.632465] [drm] features: -context_init482gitlab # [ 1.633780] [drm] number of scanouts: 1483gitlab # [ 1.633800] [drm] number of cap sets: 0484gitlab # [ 1.641705] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic485gitlab # [ 1.641742] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0486gitlab # [ 1.645489] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.487gitlab # [ 1.646858] Console: switching to colour frame buffer device 160x50488gitlab # [ 1.654377] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device489gitlab # [ 1.655432] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.678021] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.686164] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.697589] systemd[1]: Started Journal Service.493gitlab # [ 1.695820] systemd-modules-load[95]: Using 4 probe threads494gitlab # [ 1.702004] systemd-modules-load[95]: Module 'virtio_balloon' is built in495gitlab # [ 1.703357] systemd-modules-load[95]: Module 'virtio_console' is built in496gitlab # [ 1.706267] systemd-modules-load[95]: Module 'virtio_rng' is built in497gitlab # [ 1.707527] systemd-modules-load[95]: Inserted module 'dm_mod'498gitlab # [ 1.708726] systemd-modules-load[95]: Inserted module 'virtio_gpu'499gitlab # [ 1.709900] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 1.712670] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.713949] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.714814] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.715829] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.719995] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.736279] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.755732] systemd-udevd[108]: Using default interface naming scheme 'v261'.507gitlab # [ 1.783449] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.810099] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.871694] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.875926] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.211554] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.214234] systemd[1]: Reached target System Initialization.513gitlab # [ 2.216807] systemd[1]: Reached target Basic System.514gitlab # [ 2.431618] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.448132] systemd[1]: Found device /dev/disk/by-label/nix-store.516gitlab # [ 2.458987] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.517gitlab # [ 2.464667] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 2.493877] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.494951] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.495892] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.545468] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.555991] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.579805] systemd[1]: Mounting /sysroot...524gitlab # [ 2.647205] EXT4-fs (vda): mounted filesystem fd5358cf-10c8-4293-a2a6-cb572cb57d4f r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.649125] systemd[1]: Mounted /sysroot.526gitlab # [ 2.650643] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.653728] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.654937] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.660214] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.684155] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.687610] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.691504] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.697338] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.698419] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.702105] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.713618] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.720788] systemd[1]: Mounted /sysroot/tmp/xchg.538gitlab # [ 2.723628] systemd[1]: Mounted /sysroot/tmp/shared.539gitlab # [ 2.728251] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.540gitlab # [ 2.732965] systemd[1]: Finished rw-sysroot-nix-store.service.541gitlab # [ 2.739880] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.741606] systemd[1]: Reloading...543gitlab # [ 2.984039] erofs (device vdb): mounted with root inode @ nid 128.544gitlab # [ 3.039989] systemd[1]: Reloading finished in 298 ms.545gitlab # [ 3.042151] (udev-worker)[140]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory546gitlab # [ 3.045520] (udev-worker)[140]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory547gitlab # [ 3.078747] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...548gitlab # [ 3.080374] systemd[1]: Mounted /sysroot/nix/.ro-store.549gitlab # [ 3.084753] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...550gitlab # [ 3.090217] systemd[1]: initrd-parse-etc.service: Deactivated successfully.551gitlab # [ 3.091929] systemd[1]: Finished Mountpoints Configured in the Real Root.552gitlab # [ 3.093659] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.553gitlab # [ 3.097161] systemd[1]: Starting rw-sysroot-nix-store.service...554gitlab # [ 3.098683] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.555gitlab # [ 3.100494] systemd[1]: Stopped Virtual Console Setup.556gitlab # [ 3.101761] systemd[1]: Stopping Virtual Console Setup...557gitlab # [ 3.103085] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 3.155918] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.559gitlab # [ 3.157866] systemd[1]: Finished rw-sysroot-nix-store.service.560gitlab # [ 3.177102] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.181407] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.585559] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.661917] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.664251] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.666702] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.669099] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.717148] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.721056] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.738394] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.740814] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.743216] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.809060] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.811640] systemd[1]: Stopped target Basic System.574gitlab # [ 3.813976] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.816411] systemd[1]: Stopped target Path Units.576gitlab # [ 3.818553] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.821902] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.825298] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.827477] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.830922] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.833709] systemd[1]: Stopped target Swaps.582gitlab # [ 3.835737] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.838085] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.840672] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.843416] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.848325] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.851206] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.853686] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.855839] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.858359] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.860250] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.862683] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.864325] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.866720] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.869027] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.871083] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.872827] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.874296] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.876121] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 3.878008] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 3.879417] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 3.881306] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 3.883078] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 3.884339] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 3.885920] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 3.887482] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 3.890264] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 3.891596] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.893272] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.894739] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 3.896227] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 3.897777] systemd[1]: systemd-udevd.service: Consumed 2.319s CPU time over 2.175s wall clock time, 31.4M memory peak.613gitlab # [ 3.900032] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 3.901609] systemd[1]: Closed udev Control Socket.615gitlab # [ 3.902708] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 3.903893] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 3.905667] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 3.906998] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 3.908768] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 3.910261] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 3.911728] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.004548] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.007968] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.011395] systemd[1]: Reached target Switch Root.625gitlab # [ 4.013699] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.187900] initrd-nixos-activation-start[223]: booting system configuration /nix/store/hbqglm4gifs1s46zqxmbp5d9qkpi1ang-nixos-system-gitlab-test627gitlab # [ 4.248093] initrd-nixos-activation-start[223]: running activation script...628gitlab # [ 4.551493] initrd-nixos-activation-start[246]: setting up /etc...629gitlab # [ 4.719455] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.723071] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.725427] systemd[1]: Starting Switch Root...632gitlab # [ 4.778867] systemd[1]: Switching root.633gitlab # [ 4.909700] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.531298] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.531443] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.531513] systemd[1]: Detected architecture arm64.637gitlab # [ 5.531659] systemd[1]: Detected first boot.638gitlab # [ 5.532997] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 5.779641] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 5.901897] systemd[1]: Applying preset policy.641gitlab # [ 6.097797] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.251246] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.251634] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.253815] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.262058] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.265747] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.269837] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.270417] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.271751] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.272896] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.273996] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.275063] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.276148] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.277229] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.278348] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.279383] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.280453] systemd[1]: Reached target Path Units.658gitlab # [ 6.281447] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.281826] systemd[1]: Reached target Slice Units.660gitlab # [ 6.282104] systemd[1]: Reached target Swaps.661gitlab # [ 6.283502] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.284960] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.286161] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.287608] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.288154] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.292988] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.294391] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.298676] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.300358] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.301561] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.302617] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.308849] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.310276] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.311683] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.365789] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.371093] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.377207] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.387971] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.399015] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.409697] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.410794] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.425604] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.426658] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.429659] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.445611] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.449088] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.462521] systemd[1]: Starting Journal Service...688gitlab # [ 6.467475] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.477669] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.485648] fuse: init (API version 7.45)691gitlab # [ 6.487089] systemd[1]: Starting Remount Root and Kernel File Systems...692gitlab # [ 6.487974] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os693gitlab # [ 6.497561] systemd[1]: Starting Coldplug All udev Devices...694gitlab # [ 6.505221] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 6.506176] systemd[1]: Mounted Huge Pages File System.696gitlab # [ 6.507176] systemd[1]: Mounted POSIX Message Queue File System.697gitlab # [ 6.508130] systemd[1]: Mounted Kernel Debug File System.698gitlab # [ 6.509015] systemd[1]: Mounted Kernel Trace File System.699gitlab # [ 6.510366] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 6.511490] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 6.512543] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 6.513523] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 6.514574] systemd[1]: modprobe@fuse.service: Deactivated successfully.704gitlab # [ 6.515702] systemd[1]: Finished Load Kernel Module fuse.705gitlab # [ 6.523777] systemd[1]: Mounting FUSE Control File System...706gitlab # [ 6.533534] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...707gitlab # [ 6.535289] systemd[1]: Finished Load Kernel Modules.708gitlab # [ 6.542770] systemd[1]: Starting Firewall...709gitlab # [ 6.547971] systemd-journald[317]: Collecting audit messages is enabled.710gitlab # [ 6.569467] systemd[1]: Starting Apply Kernel Variables...711gitlab # [ 6.571370] systemd[1]: Mounted FUSE Control File System.712gitlab # [ 6.573893] systemd[1]: Queued start job for default target Multi-User System.713gitlab # [ 6.576584] systemd[1]: Started Journal Service.714gitlab # [ 6.580529] EXT4-fs (vda): re-mounted fd5358cf-10c8-4293-a2a6-cb572cb57d4f.715gitlab # [ 6.584382] systemd[1]: Unnecessary job was removed for /dev/vdb.716gitlab # [ 6.585813] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 6.589786] systemd-modules-load[318]: Using 3 probe threads718gitlab # [ 6.591328] systemd-modules-load[318]: Module 'atkbd' is built in719gitlab # [ 6.595577] systemd-modules-load[318]: Module 'loop' is built in720gitlab # [ 6.598418] systemd-modules-load[318]: Inserted module 'tls'721gitlab # [ 6.600086] systemd[1]: Finished Remount Root and Kernel File Systems.722gitlab # [ 6.604465] systemd[1]: Finished Apply Kernel Variables.723gitlab # [ 6.605935] systemd[1]: Listening on Disk Image Download Service Socket.724gitlab # [ 6.607565] systemd[1]: Starting Flush Journal to Persistent Storage...725gitlab # [ 6.609196] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore726gitlab # [ 6.612439] systemd[1]: Starting Load/Save OS Random Seed...727gitlab # [ 6.616452] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os728gitlab # [ 6.618592] systemd-oomd[319]: No swap; memory pressure usage will be degraded729gitlab # [ 6.624786] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.730gitlab # [ 6.626000] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.731gitlab # [ 6.634026] systemd-journald[317]: Received client request to flush runtime journal.732gitlab # [ 6.668486] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 6.670918] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 6.672949] systemd[1]: Reached target First Boot Complete.735gitlab # [ 6.675326] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 6.677124] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.678947] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.681137] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.719168] systemd-udevd[360]: Using default interface naming scheme 'v261'.740gitlab # [ 6.747669] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.056593] systemd[1]: Finished Firewall.742gitlab # [ 7.200777] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.256622] systemd[1]: Mounting /run/wrappers...744gitlab # [ 7.322102] systemd[1]: Mounted /run/wrappers.745gitlab # [ 7.329240] systemd[1]: Reached target Local File Systems.746gitlab # [ 7.331507] systemd[1]: Listening on Boot Loader Control Service Socket.747gitlab # [ 7.334700] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs748gitlab # [ 7.339112] systemd[1]: Starting register-nix-paths.service...749gitlab # [ 7.342878] systemd[1]: Starting Create SUID/SGID Wrappers...750gitlab # [ 7.345323] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.751gitlab # [ 7.360408] systemd[1]: Starting Save Transient machine-id to Disk...752gitlab # [ 7.371366] systemd[1]: Starting Create System Files and Directories...753gitlab # [ 7.403098] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.754gitlab # [ 7.421671] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.755gitlab # [ 7.427508] systemd[1]: Finished Save Transient machine-id to Disk.756gitlab # [ 7.442828] systemd[1]: Finished Create System Files and Directories.757gitlab # [ 7.474516] (udev-worker)[400]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.758gitlab # [ 7.477935] (udev-worker)[400]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.490604] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.760gitlab # [ 7.492728] (udev-worker)[399]: Network interface NamePolicy= disabled on kernel command line.761gitlab # [ 7.494247] systemd[1]: Condition check resulted in Virtio network device being skipped.762gitlab # [ 7.495692] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore763gitlab # [ 7.497825] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.764gitlab # [ 7.499589] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67765gitlab # [ 7.507832] systemd[1]: Starting Rebuild Journal Catalog...766gitlab # [ 7.509081] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore767gitlab # [ 7.511351] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os768gitlab # [ 7.513212] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os769gitlab # [ 7.514928] systemd[1]: Starting Record System Boot/Shutdown in UTMP...770gitlab # [ 7.533859] systemd[1]: Finished Record System Boot/Shutdown in UTMP.771gitlab # [ 7.552796] systemd[1]: Finished Rebuild Journal Catalog.772gitlab # [ 7.557562] systemd[1]: Starting Update is Completed...773gitlab # [ 7.580717] systemd[1]: Finished Update is Completed.774gitlab # [ 7.594155] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.595380] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.596411] systemd[1]: suid-sgid-wrappers.service: Consumed 159ms CPU time over 251ms wall clock time, 6M memory peak, 1.9M read from disk.777gitlab # [ 7.617536] mousedev: PS/2 mouse device common for all mice778gitlab # [ 7.831808] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 7.832846] systemd[1]: Reached target System Initialization.780gitlab # [ 7.833742] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 7.834790] systemd[1]: Started logrotate.timer.782gitlab # [ 7.835555] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 7.836580] systemd[1]: Reached target Timer Units.784gitlab # [ 7.837338] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 7.838293] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 7.849882] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 7.850906] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 7.852315] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 7.853322] systemd[1]: Reached target Socket Units.790gitlab # [ 7.855285] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 7.890637] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 7.892440] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 7.894348] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 7.897623] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 7.906619] dbus-broker-launch[563]: Ready796gitlab # [ 7.907814] systemd[1]: Reached target Basic System.797gitlab # [ 7.909595] systemd[1]: Started backdoor.service.798gitlab # [ 7.914160] systemd[1]: Starting gitlab-config.service...799gitlab # [ 7.932368] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 7.936086] systemd[1]: Starting Logrotate configuration check...801gitlab # [ 7.943405] systemd[1]: Starting Name Service Cache Daemon (nsncd)...802gitlab # [ 7.955790] systemd[1]: Starting Post-Boot Actions...803gitlab # [ 7.963248] systemd[1]: Started Reset console on configuration changes.804gitlab # connecting to host...805gitlab # [ 7.965735] systemd[1]: Starting resolvconf update...806gitlab # [ 7.976595] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab: Guest shell says: b'Spawning backdoor root shell...\n'808gitlab # [ 7.979250] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab # [ 7.986331] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'810gitlab: connected to guest root shell811gitlab # [ 7.987506] logrotate[568]: Reading state from file: /var/lib/logrotate.status812gitlab: (connecting took 8.45 seconds)813gitlab # [ 7.990332] logrotate[568]: state file /var/lib/logrotate.status does not exist814gitlab: (finished: waiting for the VM to finish booting, in 8.45 seconds)815gitlab # [ 7.991403] logrotate[568]: Allocating hash table for state file, size 64 entries816gitlab # [ 7.993270] logrotate[568]: Handling 4 logs817gitlab # [ 7.993834] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed818gitlab # [ 7.995960] logrotate[568]: considering log /var/log/btmp819gitlab # [ 7.997522] logrotate[568]: Creating new state820gitlab # [ 7.998100] logrotate[568]: Now: 2026-08-16 12:31821gitlab # [ 7.998713] logrotate[568]: Last rotated at 2026-08-16 12:00822gitlab # [ 7.999499] logrotate[568]: log does not need rotating (log has already been rotated)823gitlab # [ 8.002466] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed824gitlab # [ 8.008605] logrotate[568]: considering log /var/log/wtmp825gitlab # [ 8.010909] logrotate[568]: Creating new state826gitlab # [ 8.011571] logrotate[568]: Now: 2026-08-16 12:31827gitlab # [ 8.013518] logrotate[568]: Last rotated at 2026-08-16 12:00828gitlab # [ 8.014322] logrotate[568]: log does not need rotating (log has already been rotated)829gitlab # [ 8.015911] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed830gitlab # [ 8.021005] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)831gitlab # [ 8.022137] logrotate[568]: considering log /var/gitlab/state/log/*.log832gitlab # [ 8.023099] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping833gitlab # [ 8.024619] logrotate[568]: Creating new state834gitlab # [ 8.025264] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)835gitlab # [ 8.026342] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed836gitlab # [ 8.028242] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)837gitlab # [ 8.031106] logrotate[568]: considering log /var/log/nginx/*.log838gitlab # [ 8.032056] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping839gitlab # [ 8.033152] logrotate[568]: Creating new state840gitlab # [ 8.033868] logrotate[568]: not running postrotate script, since no logs were rotated841gitlab # [ 8.040119] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)842gitlab # [ 8.041313] systemd[1]: Finished Logrotate configuration check.843gitlab # [ 8.042516] nsncd[570]: Aug 16 12:31:08.873 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"844gitlab # [ 8.052287] systemd[1]: Finished Post-Boot Actions.845gitlab # [ 8.053233] systemd[1]: Started Name Service Cache Daemon (nsncd).846gitlab # [ 8.054319] systemd[1]: Reached target Host and Network Name Lookups.847gitlab # [ 8.055446] systemd[1]: Reached target User and Group Name Lookups.848gitlab # [ 8.056958] systemd[1]: Starting User Login Management...849gitlab # [ 8.057749] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.079805] systemd-logind[600]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)851gitlab # [ 8.081334] systemd-logind[600]: Watching system buttons on /dev/input/event0 (gpio-keys)852gitlab # [ 8.089148] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3853gitlab # [ 8.093283] systemd-logind[600]: New seat seat0.854gitlab # [ 8.112820] systemd[1]: Stopped target Host and Network Name Lookups.855gitlab # [ 8.153338] systemd[1]: Stopping Host and Network Name Lookups...856gitlab # [ 8.159778] systemd[1]: Stopped target User and Group Name Lookups.857gitlab # [ 8.160839] systemd[1]: Stopping User and Group Name Lookups...858gitlab # [ 8.161699] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...859gitlab # [ 8.162578] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 8.163379] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 8.164269] systemd[1]: nscd.service: Consumed 22ms CPU time over 178ms wall clock time, 7.4M memory peak, 5.8M read from disk.862gitlab # [ 8.165781] systemd[1]: Starting Name Service Cache Daemon (nsncd)...863gitlab # [ 8.170682] systemd[1]: Started User Login Management.864gitlab # [ 8.189319] systemd[1]: Starting linger-users.service...865gitlab # [ 8.192120] systemd[1]: Finished resolvconf update.866gitlab # [ 8.192889] systemd[1]: Reached target Preparation for Network.867gitlab # [ 8.202837] systemd[1]: Starting DHCP Client...868gitlab # [ 8.211662] nsncd[662]: Aug 16 12:31:09.096 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"869gitlab # [ 8.214139] systemd[1]: Starting Address configuration of eth1...870gitlab # [ 8.215833] systemd[1]: Starting Extra networking commands....871gitlab # [ 8.223015] systemd[1]: Started Name Service Cache Daemon (nsncd).872gitlab # [ 8.224154] systemd[1]: linger-users.service: Deactivated successfully.873gitlab # [ 8.225112] systemd[1]: Finished linger-users.service.874gitlab # [ 8.227190] systemd[1]: Reached target Host and Network Name Lookups.875gitlab # [ 8.228190] systemd[1]: Reached target User and Group Name Lookups.876gitlab # [ 8.273332] network-addresses-eth1-start[677]: adding address 192.168.1.1/24... done877gitlab # [ 8.281748] network-addresses-eth1-start[677]: adding address 2001:db8:1::1/64... done878gitlab # [ 8.287615] systemd[1]: Finished Address configuration of eth1.879gitlab # [ 8.359886] systemd[1]: Starting Virtual Console Setup...880gitlab # [ 8.363164] dhcpcd[712]: dhcpcd-10.3.2 starting881gitlab # [ 8.367301] dhcpcd[749]: dev: loaded udev882gitlab # [ 8.369713] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.883gitlab # [ 8.370786] systemd[1]: Stopped Virtual Console Setup.884gitlab # [ 8.375834] systemd[1]: Starting Virtual Console Setup...885gitlab # [ 8.385257] 8021q: 802.1Q VLAN Support v1.8886gitlab # [ 8.385918] 8021q: adding VLAN 0 to HW filter on device eth1887gitlab # [ 8.390011] systemd[1]: Finished Extra networking commands..888gitlab # [ 8.392460] systemd[1]: Reached target Network.889gitlab # [ 8.395053] systemd[1]: Starting gitlab-workhorse.service...890gitlab # [ 8.404138] systemd[1]: Starting Nginx Web Server...891gitlab # [ 8.408451] systemd[1]: Starting PostgreSQL Server...892gitlab # [ 8.420104] systemd[1]: Starting Redis Server - redis-gitlab...893gitlab # [ 8.425835] systemd[1]: Starting Permit User Sessions...894gitlab # [ 8.434250] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.895gitlab # [ 8.442752] cfg80211: Loading compiled-in X.509 certificates for regulatory database896gitlab # [ 8.447957] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'897gitlab # [ 8.448453] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'898gitlab # [ 8.450183] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2899gitlab # [ 8.450481] cfg80211: failed to load regulatory.db900gitlab # [ 8.453573] systemd-logind[600]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)901gitlab # [ 8.468186] systemd-vconsole-setup[754]: Configuration of first virtual console was skipped, ignoring remaining ones.902gitlab # [ 8.475499] systemd[1]: Finished Virtual Console Setup.903gitlab # [ 8.482856] systemd[1]: Finished Permit User Sessions.904gitlab # [ 8.493053] systemd[1]: Started Getty on tty1.905gitlab # [ 8.493835] systemd[1]: Reached target Login Prompts.906gitlab # [ 8.504132] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.504570] dhcpcd[749]: eth0: waiting for carrier908gitlab # [ 8.505752] dhcpcd[749]: eth0: carrier acquired909gitlab # [ 8.512192] dhcpcd[749]: DUID 00:01:00:01:32:14:6a:0d:52:54:00:12:34:56910gitlab # [ 8.513190] dhcpcd[749]: eth0: IAID 00:12:34:56911gitlab # [ 8.513936] dhcpcd[749]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.579198] nginx-pre-start[795]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.581463] nginx-pre-start[795]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.588635] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.619948] postgresql-pre-start[798]: The files belonging to this database system will be owned by user "postgres".916gitlab # [ 8.622192] postgresql-pre-start[798]: This user must also own the server process.917gitlab # [ 8.623255] postgresql-pre-start[798]: The database cluster will be initialized with locale "en_US.UTF-8".918gitlab # [ 8.624811] postgresql-pre-start[798]: The default database encoding has accordingly been set to "UTF8".919gitlab # [ 8.628244] postgresql-pre-start[798]: The default text search configuration will be set to "english".920gitlab # [ 8.630178] postgresql-pre-start[798]: Data page checksums are enabled.921gitlab # [ 8.631642] postgresql-pre-start[798]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok922gitlab # [ 8.634379] postgresql-pre-start[798]: creating subdirectories ... ok923gitlab # [ 8.635663] redis-server[794]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.924gitlab # [ 8.638107] systemd[1]: Started Redis Server - redis-gitlab.925gitlab # [ 8.638965] postgresql-pre-start[798]: selecting dynamic shared memory implementation ... posix926gitlab # [ 8.640255] redis-server[794]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo927gitlab # [ 8.641414] redis-server[794]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=794, just started928gitlab # [ 8.642849] redis-server[794]: Configuration loaded929gitlab # [ 8.643666] redis[794]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 8.644958] redis[794]: Running mode=standalone, port=0.931gitlab # [ 8.646158] redis[794]: Server initialized932gitlab # [ 8.646923] redis[794]: Ready to accept connections unix933gitlab # [ 8.647830] redis[794]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 8.676160] postgresql-pre-start[798]: selecting default "max_connections" ... 100935gitlab # [ 8.734612] postgresql-pre-start[798]: selecting default "shared_buffers" ... 128MB936gitlab # [ 9.000231] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.236307] gitlab-workhorse[821]: time="2026-08-16T12:31:10Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 9.238430] gitlab-workhorse[821]: time="2026-08-16T12:31:10Z" level=info msg="Using redis/go-redis"939gitlab # [ 9.239891] gitlab-workhorse[821]: time="2026-08-16T12:31:10Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 9.300560] postgresql-pre-start[798]: selecting default time zone ... UTC941gitlab # [ 9.302375] postgresql-pre-start[798]: creating configuration files ... ok942gitlab # [ 9.472175] dhcpcd[749]: eth0: soliciting a DHCP lease943gitlab # [ 9.488880] dhcpcd[749]: eth0: offered 10.0.2.15 from 10.0.2.2944gitlab # [ 9.508458] dhcpcd[749]: eth0: probing address 10.0.2.15/24945gitlab # [ 9.522135] postgresql-pre-start[798]: running bootstrap script ... ok946gitlab # [ 10.285277] postgresql-pre-start[798]: performing post-bootstrap initialization ... ok947gitlab # [ 10.586174] postgresql-pre-start[798]: syncing data to disk ... ok948gitlab # [ 10.589025] postgresql-pre-start[798]: initdb: warning: enabling "trust" authentication for local connections949gitlab # [ 10.592984] postgresql-pre-start[798]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.950gitlab # [ 10.599052] postgresql-pre-start[798]: Success. You can now start the database server using:951gitlab # [ 10.602566] postgresql-pre-start[798]: pg_ctl -D /var/lib/postgresql/18 -l logfile start952gitlab # [ 10.741005] dhcpcd[749]: eth0: soliciting an IPv6 router953gitlab # [ 10.743396] dhcpcd[749]: eth0: Router Advertisement from fe80::2954gitlab # [ 10.746496] dhcpcd[749]: eth0: adding address fec0::5054:ff:fe12:3456/64955gitlab # [ 10.749721] dhcpcd[749]: eth0: adding route to fec0::/64956gitlab # [ 10.752417] dhcpcd[749]: eth0: adding default route via fe80::2957gitlab # [ 10.756992] postgres[858]: [858] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 10.762784] postgres[858]: [858] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 10.767639] postgres[858]: [858] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 10.771180] postgres[858]: [858] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 10.776417] postgres[870]: [870] LOG: database system was shut down at 2026-08-16 12:31:11 GMT962gitlab # [ 10.780544] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[855]: mkdir -p /var/gitlab/state/home/.ssh: OK963gitlab # [ 10.784799] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[855]: chmod 700 /var/gitlab/state/home/.ssh: OK964gitlab # [ 10.789099] postgres[858]: [858] LOG: database system is ready to accept connections965gitlab # [ 10.793311] systemd[1]: Started PostgreSQL Server.966gitlab # [ 10.795381] systemd[1]: Starting PostgreSQL Setup Scripts...967gitlab # [ 10.876153] systemd[1]: Finished gitlab-config.service.968gitlab # [ 10.881240] systemd[1]: Started gitaly.service.969gitlab # [ 11.145045] postgresql-setup-start[894]: CREATE DATABASE970gitlab # [ 11.207771] postgresql-setup-start[904]: CREATE ROLE971gitlab # [ 11.236389] postgresql-setup-start[907]: ALTER DATABASE972gitlab # [ 11.295740] postgresql-setup-start[915]: CREATE ROLE973gitlab # [ 11.300354] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 11.302749] systemd[1]: Reached target PostgreSQL.975gitlab # [ 11.309248] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 11.311723] systemd[1]: Starting gitlab-postgresql.service...977gitlab # [ 11.443231] gitlab-postgresql-start[931]: CREATE DATABASE978gitlab # [ 11.502873] gitlab-postgresql-start[936]: CREATE EXTENSION979gitlab # [ 11.573244] gitaly[888]: time="2026-08-16T12:31:12.458Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=888980gitlab # [ 11.584133] gitaly[888]: time="2026-08-16T12:31:12.460Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=888981gitlab # [ 11.585964] gitaly[888]: time="2026-08-16T12:31:12.460Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=888982gitlab # [ 11.588406] gitaly[888]: time="2026-08-16T12:31:12.460Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=888983gitlab # [ 11.590424] gitaly[888]: time="2026-08-16T12:31:12.460Z" level=info msg="Starting Gitaly" pid=888 version=984gitlab # [ 11.596591] gitlab-postgresql-start[938]: CREATE EXTENSION985gitlab # [ 11.603539] systemd[1]: Finished gitlab-postgresql.service.986gitlab # [ 11.763178] gitaly[888]: time="2026-08-16T12:31:12.648Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=187 pid=888987gitlab # [ 11.765048] gitaly[888]: time="2026-08-16T12:31:12.648Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=888988gitlab # [ 11.766815] gitaly[888]: time="2026-08-16T12:31:12.649Z" level=info msg="finished initializing command factory" duration_ms=0 pid=888989gitlab # [ 11.768759] gitaly[888]: time="2026-08-16T12:31:12.649Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-888/git-exec-572114025.d/git pid=888990gitlab # [ 11.774708] gitaly[888]: time="2026-08-16T12:31:12.659Z" level=info msg="finished detecting git version" duration_ms=10 pid=888991gitlab # [ 11.777666] gitaly[888]: time="2026-08-16T12:31:12.659Z" level=info msg="using Git version" pid=888 version=2.53.g992gitlab # [ 11.780300] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="clearing disk cache object folder" pid=888 storage=default993gitlab # [ 11.781854] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2140259494 pid=888 storage=default994gitlab # [ 11.785692] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2140259494 pid=888 storage=default995gitlab # [ 11.792290] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=888996gitlab # [ 11.794688] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=888997gitlab # [ 11.800648] gitaly[888]: time="2026-08-16T12:31:12.660Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2140259494 clear_duration_ms=0 pid=888 storage=default998gitlab # [ 11.804278] gitaly[888]: time="2026-08-16T12:31:12.689Z" level=info msg="counting repositories" pid=888999gitlab # [ 11.807651] gitaly[888]: time="2026-08-16T12:31:12.689Z" level=info msg="starting to count repositories" pid=888 storage_path=/var/gitlab/state/repositories1000gitlab # [ 11.809845] gitaly[888]: time="2026-08-16T12:31:12.689Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8881001gitlab # [ 11.812290] gitaly[888]: time="2026-08-16T12:31:12.689Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=888 schema=unix1002gitlab # [ 11.814310] gitaly[888]: time="2026-08-16T12:31:12.689Z" level=info msg="listening at address" address=/run/gitaly/gitaly-888/sock.d/intern pid=888 schema=unix1003gitlab # [ 11.816363] gitaly[888]: time="2026-08-16T12:31:12.691Z" level=info msg="completed counting repositories" counting_duration_ms=1 pid=888 storage_path=/var/gitlab/state/repositories1004gitlab # [ 11.818504] gitaly[888]: time="2026-08-16T12:31:12.691Z" level=info msg="completed counting all repositories" counting_duration=1 pid=8881005gitlab # [ 11.820242] gitaly[888]: time="2026-08-16T12:31:12.691Z" level=info msg="finished tempdir cleaner walk" pid=888 storage=default time_ms=01006gitlab # [ 11.821890] gitaly[888]: time="2026-08-16T12:31:12.692Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8881007gitlab # [ 11.823531] gitaly[888]: time="2026-08-16T12:31:12.692Z" level=info msg="Started Gitaly" duration_ms=232 pid=8881008gitlab # [ 11.824974] gitaly[888]: time="2026-08-16T12:31:12.692Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8881009gitlab # [ 11.826958] gitaly[888]: time="2026-08-16T12:31:12.693Z" level=info msg="maintenance: daily scheduled" pid=888 scheduled="2026-08-17 12:00:00 +0000 UTC"1010gitlab # [ 12.587947] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.598337] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.608692] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[929]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 13.875731] dhcpcd[749]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 13.876100] dhcpcd[749]: eth0: adding route to 10.0.2.0/241015gitlab # [ 13.876242] dhcpcd[749]: eth0: adding default route via 10.0.2.21016gitlab # [ 14.022564] systemd[1]: Started DHCP Client.1017gitlab # [ 14.025883] systemd[1]: Reached target Network is Online.1018gitlab # [ 15.186321] gitaly[888]: time="2026-08-16T12:31:16.070Z" level=info msg="License database preloaded" duration_ms=3610 pid=8881019gitlab # [ 57.239690] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[929]: W, [2026-08-16T12:31:58.123335 #929] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.321582] gitlab-workhorse[821]: time="2026-08-16T12:32:00Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 61.050139] postgres[1437]: [1437] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 61.050647] postgres[1437]: [1437] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 61.050781] postgres[1437]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 61.050898] postgres[1437]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 61.051011] postgres[1437]: attidentity AS identity,1026gitlab # [ 61.051121] postgres[1437]: attgenerated as attgenerated1027gitlab # [ 61.051218] postgres[1437]: FROM pg_attribute a1028gitlab # [ 61.051326] postgres[1437]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 61.051439] postgres[1437]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 61.051575] postgres[1437]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 61.051692] postgres[1437]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 61.051805] postgres[1437]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 61.051916] postgres[1437]: ORDER BY a.attnum1034gitlab # [ 61.089382] postgres[1437]:1035gitlab # [ 66.200573] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1488]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 66.200986] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1488]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.322620] gitlab-workhorse[821]: time="2026-08-16T12:32:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.330392] gitlab-workhorse[821]: time="2026-08-16T12:32:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.338370] gitlab-workhorse[821]: time="2026-08-16T12:32:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 90.756647] postgres[1582]: [1582] ERROR: relation "table_without_models" does not exist1041gitlab # [ 90.756998] postgres[1582]: [1582] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.346629] gitlab-workhorse[821]: time="2026-08-16T12:32:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.354329] gitlab-workhorse[821]: time="2026-08-16T12:32:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.364559] gitlab-workhorse[821]: time="2026-08-16T12:33:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 122.108318] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 122.112849] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 122.116838] systemd[1]: Starting gitlab.service...1048gitlab # [ 122.670720] bundle[1966]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 122.677164] bundle[1966]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 122.683091] bundle[1966]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 127.422935] sidekiq-cluster[1965]: {"severity":"INFO","time":"2026-08-16T12:33:08.279Z","message":"Starting cluster with 1 processes"}1052gitlab # [ 127.509011] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.363Z","pid":1966,"message":"* Enabling systemd notification integration"}1053gitlab # [ 127.514015] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"Puma starting in cluster mode..."}1054gitlab # [ 127.518508] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1055gitlab # [ 127.523292] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1056gitlab # [ 127.529260] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Min threads: 0"}1057gitlab # [ 127.533169] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Max threads: 4"}1058gitlab # [ 127.537139] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Environment: production"}1059gitlab # [ 127.541959] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Master PID: 1966"}1060gitlab # [ 127.546183] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Workers: 2"}1061gitlab # [ 127.550554] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1062gitlab # [ 127.555941] bundle[1966]: {"timestamp":"2026-08-16T12:33:08.393Z","pid":1966,"message":"* Preloading application"}1063gitlab # [ 129.368088] gitlab-workhorse[821]: time="2026-08-16T12:33:10Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 139.370605] gitlab-workhorse[821]: time="2026-08-16T12:33:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.381628] gitlab-workhorse[821]: time="2026-08-16T12:33:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.392492] gitlab-workhorse[821]: time="2026-08-16T12:33:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 166.840870] bundle[1966]: W, [2026-08-16T12:33:47.724792 #1966] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 169.402624] gitlab-workhorse[821]: time="2026-08-16T12:33:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 169.781016] sidekiq-cluster[2014]: 2026-08-16T12:33:50.664Z pid=2014 tid=wom INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2014, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>429858816}1070gitlab # [ 170.070290] sidekiq-cluster[2014]: W, [2026-08-16T12:33:50.955277 #2014] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1071gitlab # [ 170.136824] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:51.021Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1072gitlab # [ 173.783005] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.667Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 173.783387] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.667Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 173.815862] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.701Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 173.832648] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.717Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 173.841592] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.726Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 173.856547] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.741Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 173.871743] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.756Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 173.885874] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.770Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 173.899372] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.784Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 173.905905] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.789Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 173.912314] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.793Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 173.918578] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.798Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 173.924948] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.804Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 173.930452] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.810Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 173.935013] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.815Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 173.939602] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.820Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 173.943848] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.824Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 173.947909] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.828Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 173.951556] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.834Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 173.954929] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.839Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 173.958460] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.843Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 173.962668] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.847Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 173.966983] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.852Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 173.970639] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.855Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 173.973781] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.858Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 173.976922] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.861Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 173.980054] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.864Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 173.983029] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.867Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 173.986078] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.871Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 173.989364] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.874Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 173.992874] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.878Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 173.995957] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.880Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 173.999040] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.883Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 174.002397] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.886Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 174.005440] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.889Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 174.008586] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.892Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 174.011589] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.894Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 174.014780] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.896Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 174.017832] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.898Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 174.021565] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.900Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 174.024195] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.903Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 174.026723] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.905Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 174.029585] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.907Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 174.032310] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.909Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 174.035016] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.911Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 174.037739] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.913Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 174.040511] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.916Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 174.043284] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.918Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 174.046021] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.920Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 174.048545] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.923Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 174.050941] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.925Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 174.053408] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.927Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 174.055653] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.930Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 174.058023] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.932Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 174.060201] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.944Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 174.062590] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.946Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 174.064908] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.949Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 174.067137] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.951Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 174.069465] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.953Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 174.071775] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.956Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 174.074194] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.958Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 174.076452] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.960Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 174.078482] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.962Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 174.080548] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.964Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 174.082681] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.966Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 174.084912] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.969Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 174.087121] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.971Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 174.089409] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.974Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 174.091471] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.976Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 174.093801] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.978Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 174.096085] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.979Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 174.098352] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.981Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 174.100585] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.983Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 174.102774] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.985Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 174.105008] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.987Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 174.107274] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.988Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 174.109652] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.990Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 174.111874] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.992Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 174.114213] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.994Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 174.116707] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.996Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 174.118885] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.997Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 174.121086] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:54.999Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 174.123395] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.001Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 174.125947] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.003Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 174.128240] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.005Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 174.130403] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.007Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 174.132792] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.010Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 174.134959] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.012Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 174.137385] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.014Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 174.139597] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.016Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 174.142097] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.018Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 174.144375] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.020Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 174.146570] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.022Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 174.148780] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.024Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 174.150952] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.025Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 174.153397] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.027Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 174.155374] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.029Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 174.157861] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.032Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 174.160112] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.034Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 174.162329] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.036Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 174.164607] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.046Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 174.166813] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.048Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 174.169066] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.050Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 174.171304] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.054Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 174.173473] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.056Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 174.175880] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.060Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 174.178451] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.063Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 174.180845] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.065Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 174.183013] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.067Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 174.185365] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.070Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 174.187857] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:33:55.072Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 179.412646] gitlab-workhorse[821]: time="2026-08-16T12:34:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 189.422805] gitlab-workhorse[821]: time="2026-08-16T12:34:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.432356] gitlab-workhorse[821]: time="2026-08-16T12:34:20Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.438227] gitlab-workhorse[821]: time="2026-08-16T12:34:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 213.985780] postgres[2743]: [2743] ERROR: relation "table_without_models" does not exist1188gitlab # [ 213.988513] postgres[2743]: [2743] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 218.526244] postgres[2783]: [2783] ERROR: relation "table_without_models" does not exist1190gitlab # [ 218.526584] postgres[2783]: [2783] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 218.951271] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:39.835Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 218.956222] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:39.838Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 218.962250] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:39.838Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 218.967681] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:39.838Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 218.973877] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:39.840Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 219.446113] gitlab-workhorse[821]: time="2026-08-16T12:34:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197gitlab # [ 221.707198] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:42.591Z","message":"Cleaning working queues"}1198gitlab # [ 221.708465] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:42.592Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"19c9e2cb68c692f847b1c69c","created_at":"2026-08-16T12:33:02.389Z","trace_propagation_headers":{"sentry-trace":"7edaf2c415fc40f09078748802ed1145-7b4f90b28f2345f0","baggage":"sentry-trace_id=7edaf2c415fc40f09078748802ed1145,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"97084b3f403147468ea4f768d89189e1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T12:33:02.401Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-19c9e2cb68c692f847b1c69c: start","job_status":"start","queue_duration_s":100.191807,"scheduling_latency_s":100.191869}1199gitlab # [ 222.049624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:42.933Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"19c9e2cb68c692f847b1c69c","created_at":"2026-08-16T12:33:02.389Z","trace_propagation_headers":{"sentry-trace":"7edaf2c415fc40f09078748802ed1145-7b4f90b28f2345f0","baggage":"sentry-trace_id=7edaf2c415fc40f09078748802ed1145,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"97084b3f403147468ea4f768d89189e1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T12:33:02.401Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-19c9e2cb68c692f847b1c69c: done: 0.340945 sec","job_status":"done","queue_duration_s":100.191807,"scheduling_latency_s":100.191869,"redis_calls":29,"redis_duration_s":0.018978000000000002,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.01369,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003335,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19670202,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.340945,"completed_at":"2026-08-16T12:34:42.933Z","load_balancing_strategy":"primary","db_duration_s":0.097171,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1200gitlab # [ 225.628386] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.512Z","pid":1966,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 225.628736] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.512Z","pid":1966,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 225.628861] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.512Z","pid":1966,"message":"! #\u003cThread:0x0000e58211d12918 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 225.629038] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.512Z","pid":1966,"message":"! #\u003cThread:0x0000e58211f137f8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 225.629182] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.512Z","pid":1966,"message":"Use Ctrl-C to stop"}1205gitlab # [ 225.629278] bundle[1966]: {"timestamp":"2026-08-16T12:34:46.513Z","pid":1966,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 228.773034] bundle[1966]: {"timestamp":"2026-08-16T12:34:49.657Z","pid":1966,"message":"- Worker 0 (PID: 2900) booted in 3.11s, phase: 0"}1207gitlab # [ 228.777794] bundle[1966]: {"timestamp":"2026-08-16T12:34:49.662Z","pid":1966,"message":"- Worker 1 (PID: 2904) booted in 3.09s, phase: 0"}1208gitlab # [ 228.783212] systemd[1]: Started gitlab.service.1209gitlab # [ 228.785738] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 228.789015] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 228.819265] setup-gitlab-start[2955]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 229.771009] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:34:50 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 9061213gitlab # [ 229.777129] setup-gitlab-start[2955]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 229.780320] setup-gitlab-start[2955]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 229.796876] runuser[2973]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 230.310832] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 230.317719] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 230.323987] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 231.129149] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 231.129504] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 231.131668] setup-gitlab-start[2974]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 231.920400] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:52.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"199b6b71a18fcc568ec82021","created_at":"2026-08-16T12:34:52.700Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a919548fbaba21a024aa348bbca0931d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.800Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-199b6b71a18fcc568ec82021: start","job_status":"start","queue_duration_s":0.003206,"scheduling_latency_s":0.003259}1223gitlab # [ 232.174939] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"199b6b71a18fcc568ec82021","created_at":"2026-08-16T12:34:52.700Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a919548fbaba21a024aa348bbca0931d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.800Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-199b6b71a18fcc568ec82021: done: 0.254593 sec","job_status":"done","queue_duration_s":0.003206,"scheduling_latency_s":0.003259,"redis_calls":10,"redis_duration_s":0.039368,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003899,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.032067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00163986,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.254593,"completed_at":"2026-08-16T12:34:53.058Z","load_balancing_strategy":"primary","db_duration_s":0.079444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 232.272683] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3f55043fc179f24e81e1fd07","created_at":"2026-08-16T12:34:52.812Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81e417c2ed7718f718927c406d046ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.833Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3f55043fc179f24e81e1fd07: start","job_status":"start","queue_duration_s":0.238537,"scheduling_latency_s":0.238585}1225gitlab # [ 232.337469] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3f55043fc179f24e81e1fd07","created_at":"2026-08-16T12:34:52.812Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81e417c2ed7718f718927c406d046ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.833Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3f55043fc179f24e81e1fd07: done: 0.149539 sec","job_status":"done","queue_duration_s":0.238537,"scheduling_latency_s":0.238585,"redis_calls":10,"redis_duration_s":0.027577,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002982,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.018424,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044316,"duration_s":0.149539,"completed_at":"2026-08-16T12:34:53.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 232.405334] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"524080a06d0533b03974b75c","created_at":"2026-08-16T12:34:52.867Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62111ee956cd61badee72f48bd98f1bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.891Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-524080a06d0533b03974b75c: start","job_status":"start","queue_duration_s":0.347467,"scheduling_latency_s":0.347521}1227gitlab # [ 232.632895] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"524080a06d0533b03974b75c","created_at":"2026-08-16T12:34:52.867Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62111ee956cd61badee72f48bd98f1bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.891Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-524080a06d0533b03974b75c: done: 0.278061 sec","job_status":"done","queue_duration_s":0.347467,"scheduling_latency_s":0.347521,"redis_calls":16,"redis_duration_s":0.056246000000000004,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.011313,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.034159,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0020588,"duration_s":0.278061,"completed_at":"2026-08-16T12:34:53.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 232.731791] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"af405ae941cd98b331281786","created_at":"2026-08-16T12:34:52.909Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b97ab13d1dff2dc468a9338a5ab84174","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.922Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-af405ae941cd98b331281786: start","job_status":"start","queue_duration_s":0.602111,"scheduling_latency_s":0.602165}1229gitlab # [ 232.829664] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"af405ae941cd98b331281786","created_at":"2026-08-16T12:34:52.909Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b97ab13d1dff2dc468a9338a5ab84174","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.922Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-af405ae941cd98b331281786: done: 0.187215 sec","job_status":"done","queue_duration_s":0.602111,"scheduling_latency_s":0.602165,"redis_calls":12,"redis_duration_s":0.082938,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.073988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005398,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00158208,"exclusive_lock_hold_duration_s":0.03073144,"duration_s":0.187215,"completed_at":"2026-08-16T12:34:53.711Z","load_balancing_strategy":"primary","db_duration_s":0.023639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 232.927459] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7470f89c9014249c59c58a86","created_at":"2026-08-16T12:34:52.936Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01fc680817dde358838088ebe311618f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.956Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7470f89c9014249c59c58a86: start","job_status":"start","queue_duration_s":0.766917,"scheduling_latency_s":0.766973}1231gitlab # [ 232.993970] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.878Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1232gitlab # [ 233.085330] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7470f89c9014249c59c58a86","created_at":"2026-08-16T12:34:52.936Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01fc680817dde358838088ebe311618f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.956Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7470f89c9014249c59c58a86: done: 0.245649 sec","job_status":"done","queue_duration_s":0.766917,"scheduling_latency_s":0.766973,"redis_calls":10,"redis_duration_s":0.065725,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008555,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.047604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00332948,"duration_s":0.245649,"completed_at":"2026-08-16T12:34:53.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 233.188366] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:53.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"21a48220a6359a6554c500dd","created_at":"2026-08-16T12:34:52.987Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"330539d0b2d7d1fb4f7f60458a474704","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.997Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-21a48220a6359a6554c500dd: start","job_status":"start","queue_duration_s":0.981581,"scheduling_latency_s":0.981755}1234gitlab # [ 233.207076] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.054Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1235gitlab # [ 233.211661] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"21a48220a6359a6554c500dd","created_at":"2026-08-16T12:34:52.987Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"330539d0b2d7d1fb4f7f60458a474704","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:52.997Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-21a48220a6359a6554c500dd: done: 0.107635 sec","job_status":"done","queue_duration_s":0.981581,"scheduling_latency_s":0.981755,"redis_calls":10,"redis_duration_s":0.007445,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0011628,"duration_s":0.107635,"completed_at":"2026-08-16T12:34:54.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 233.255822] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f69535a1cc8d6ca14ebaef86","created_at":"2026-08-16T12:34:53.008Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfba562a7c973b1abe73b0c9cd301cc1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.023Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f69535a1cc8d6ca14ebaef86: start","job_status":"start","queue_duration_s":1.065223,"scheduling_latency_s":1.065252}1237gitlab # [ 233.270731] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"f69535a1cc8d6ca14ebaef86","created_at":"2026-08-16T12:34:53.008Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfba562a7c973b1abe73b0c9cd301cc1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.023Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-f69535a1cc8d6ca14ebaef86: done: 0.058814 sec","job_status":"done","queue_duration_s":1.065223,"scheduling_latency_s":1.065252,"redis_calls":12,"redis_duration_s":0.005542999999999999,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002485,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00108546,"exclusive_lock_hold_duration_s":0.01129142,"duration_s":0.058814,"completed_at":"2026-08-16T12:34:54.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 233.313771] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"10affbed724cfe3f9a635223","created_at":"2026-08-16T12:34:53.052Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bbfed7c16b3338ba62972695df606c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.070Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-10affbed724cfe3f9a635223: start","job_status":"start","queue_duration_s":1.081032,"scheduling_latency_s":1.081058}1239gitlab # [ 233.332565] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"10affbed724cfe3f9a635223","created_at":"2026-08-16T12:34:53.052Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bbfed7c16b3338ba62972695df606c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.070Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-10affbed724cfe3f9a635223: done: 0.054532 sec","job_status":"done","queue_duration_s":1.081032,"scheduling_latency_s":1.081058,"redis_calls":12,"redis_duration_s":0.0049099999999999994,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001736,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082666,"duration_s":0.054532,"completed_at":"2026-08-16T12:34:54.205Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 233.382196] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"51218e26fb7b60ff639349f3","created_at":"2026-08-16T12:34:53.110Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c4cc937c56445995577b036b4dd62e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:34:53.132Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-51218e26fb7b60ff639349f3: start","job_status":"start","queue_duration_s":1.077096,"scheduling_latency_s":1.077119}1241gitlab # [ 233.399874] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.237Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1242gitlab # [ 233.403524] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"51218e26fb7b60ff639349f3","created_at":"2026-08-16T12:34:53.110Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c4cc937c56445995577b036b4dd62e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:34:53.132Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-51218e26fb7b60ff639349f3: done: 0.047686 sec","job_status":"done","queue_duration_s":1.077096,"scheduling_latency_s":1.077119,"redis_calls":10,"redis_duration_s":0.0044210000000000005,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000629,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00076092,"duration_s":0.047686,"completed_at":"2026-08-16T12:34:54.257Z","load_balancing_strategy":"primary","db_duration_s":0.000558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 233.445603] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.260Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0c1a9c95af8925094216ddfb","created_at":"2026-08-16T12:34:53.150Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa59de275ebf06a35341b5d56c211807","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:34:53.181Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0c1a9c95af8925094216ddfb: start","job_status":"start","queue_duration_s":1.078352,"scheduling_latency_s":1.078374}1244gitlab # [ 233.459157] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0c1a9c95af8925094216ddfb","created_at":"2026-08-16T12:34:53.150Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa59de275ebf06a35341b5d56c211807","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:34:53.181Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0c1a9c95af8925094216ddfb: done: 0.053136 sec","job_status":"done","queue_duration_s":1.078352,"scheduling_latency_s":1.078374,"redis_calls":10,"redis_duration_s":0.002655,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032432,"duration_s":0.053136,"completed_at":"2026-08-16T12:34:54.312Z","load_balancing_strategy":"primary","db_duration_s":0.004729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 233.500843] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1abd55e6fda6dd1b62b64029","created_at":"2026-08-16T12:34:53.191Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2dd4a64eafc587bfa1462ffe9a9ae6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.215Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1abd55e6fda6dd1b62b64029: start","job_status":"start","queue_duration_s":1.099484,"scheduling_latency_s":1.099506}1246gitlab # [ 233.515089] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.339Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1247gitlab # [ 233.518895] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1abd55e6fda6dd1b62b64029","created_at":"2026-08-16T12:34:53.191Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2dd4a64eafc587bfa1462ffe9a9ae6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.215Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1abd55e6fda6dd1b62b64029: done: 0.043361 sec","job_status":"done","queue_duration_s":1.099484,"scheduling_latency_s":1.099506,"redis_calls":10,"redis_duration_s":0.0032080000000000003,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082912,"duration_s":0.043361,"completed_at":"2026-08-16T12:34:54.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 233.563640] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a04cae1c1f5ef3d31bb105ea","created_at":"2026-08-16T12:34:53.230Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.244Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a04cae1c1f5ef3d31bb105ea: start","job_status":"start","queue_duration_s":1.117135,"scheduling_latency_s":1.117155}1249gitlab # [ 233.577920] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a04cae1c1f5ef3d31bb105ea","created_at":"2026-08-16T12:34:53.230Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.244Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a04cae1c1f5ef3d31bb105ea: done: 0.092552 sec","job_status":"done","queue_duration_s":1.117135,"scheduling_latency_s":1.117155,"redis_calls":19,"redis_duration_s":0.008123,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002084,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000685,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003794,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00156,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089382,"duration_s":0.092552,"completed_at":"2026-08-16T12:34:54.453Z","load_balancing_strategy":"primary","db_duration_s":0.004093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 233.621886] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:54.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9236d2095c06f293c9e45b97","created_at":"2026-08-16T12:34:53.249Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01ecfdfeec01bd6f4da885d5ee64218f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.257Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9236d2095c06f293c9e45b97: start","job_status":"start","queue_duration_s":1.198416,"scheduling_latency_s":1.198436}1251gitlab # [ 234.424547] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.307Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9236d2095c06f293c9e45b97","created_at":"2026-08-16T12:34:53.249Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01ecfdfeec01bd6f4da885d5ee64218f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.257Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9236d2095c06f293c9e45b97: done: 0.850761 sec","job_status":"done","queue_duration_s":1.198416,"scheduling_latency_s":1.198436,"redis_calls":565,"redis_duration_s":0.199129,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.195633,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.722414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038956,"duration_s":0.850761,"completed_at":"2026-08-16T12:34:55.307Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 234.425359] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fed5d9c60105be2a415c9f13","created_at":"2026-08-16T12:34:53.278Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe379ad51fc55def26945d4aae75ecc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:34:53.286Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fed5d9c60105be2a415c9f13: start","job_status":"start","queue_duration_s":2.023979,"scheduling_latency_s":2.024007}1253gitlab # [ 234.522384] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.338Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1254gitlab # [ 234.522478] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fed5d9c60105be2a415c9f13","created_at":"2026-08-16T12:34:53.278Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe379ad51fc55def26945d4aae75ecc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:34:53.286Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fed5d9c60105be2a415c9f13: done: 0.042956 sec","job_status":"done","queue_duration_s":2.023979,"scheduling_latency_s":2.024007,"redis_calls":10,"redis_duration_s":0.003085,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001615,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005038,"duration_s":0.042956,"completed_at":"2026-08-16T12:34:55.353Z","load_balancing_strategy":"primary","db_duration_s":0.001148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 235.208329] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.356Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a6b31a29700f2fb47f573d2d","created_at":"2026-08-16T12:34:53.297Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b36bf40e74bd4a5244409b83ad89a754","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.304Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a6b31a29700f2fb47f573d2d: start","job_status":"start","queue_duration_s":2.052495,"scheduling_latency_s":2.05258}1256gitlab # [ 235.208700] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a6b31a29700f2fb47f573d2d","created_at":"2026-08-16T12:34:53.297Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b36bf40e74bd4a5244409b83ad89a754","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.304Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a6b31a29700f2fb47f573d2d: done: 0.205302 sec","job_status":"done","queue_duration_s":2.052495,"scheduling_latency_s":2.05258,"redis_calls":14,"redis_duration_s":0.00672,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001083,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00238,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00125032,"exclusive_lock_hold_duration_s":0.12904301999999998,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.205302,"completed_at":"2026-08-16T12:34:55.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 235.934678] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"834a83c1fe4a87f14c85d40f","created_at":"2026-08-16T12:34:53.314Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb71b0bc3a18a012e8e24c47d63a15e5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.320Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-834a83c1fe4a87f14c85d40f: start","job_status":"start","queue_duration_s":2.248134,"scheduling_latency_s":2.24818}1258gitlab # [ 235.934939] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"834a83c1fe4a87f14c85d40f","created_at":"2026-08-16T12:34:53.314Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb71b0bc3a18a012e8e24c47d63a15e5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.320Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-834a83c1fe4a87f14c85d40f: done: 0.09928 sec","job_status":"done","queue_duration_s":2.248134,"scheduling_latency_s":2.24818,"redis_calls":10,"redis_duration_s":0.0051649999999999995,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001172,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088472,"duration_s":0.09928,"completed_at":"2026-08-16T12:34:55.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 236.606005] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"17937acf90b8947dc31fad32","created_at":"2026-08-16T12:34:53.356Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.374Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-17937acf90b8947dc31fad32: start","job_status":"start","queue_duration_s":2.297374,"scheduling_latency_s":2.297526}1260gitlab # [ 237.276690] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"17937acf90b8947dc31fad32","created_at":"2026-08-16T12:34:53.356Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.374Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-17937acf90b8947dc31fad32: done: 0.206298 sec","job_status":"done","queue_duration_s":2.297374,"scheduling_latency_s":2.297526,"redis_calls":71,"redis_duration_s":0.028201,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004469,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.002863,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.019761,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.167701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007041,"duration_s":0.206298,"completed_at":"2026-08-16T12:34:55.877Z","load_balancing_strategy":"primary","db_duration_s":0.005609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 237.974440] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:55.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"99411a600edfbce0fe4ae493","created_at":"2026-08-16T12:34:53.396Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f575ef5493ca83dc4508a09c4a20d848","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.413Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-99411a600edfbce0fe4ae493: start","job_status":"start","queue_duration_s":2.467548,"scheduling_latency_s":2.467634}1262gitlab # [ 238.019033] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"99411a600edfbce0fe4ae493","created_at":"2026-08-16T12:34:53.396Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f575ef5493ca83dc4508a09c4a20d848","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.413Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-99411a600edfbce0fe4ae493: done: 0.13934 sec","job_status":"done","queue_duration_s":2.467548,"scheduling_latency_s":2.467634,"redis_calls":10,"redis_duration_s":0.013106,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00122132,"duration_s":0.13934,"completed_at":"2026-08-16T12:34:56.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 238.092742] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"06a359365c9f8bb349aeb5c7","created_at":"2026-08-16T12:34:53.425Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"127dcff986e975685cc553aa0edf0a9b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.442Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-06a359365c9f8bb349aeb5c7: start","job_status":"start","queue_duration_s":2.583818,"scheduling_latency_s":2.583857}1264gitlab # [ 238.112884] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"06a359365c9f8bb349aeb5c7","created_at":"2026-08-16T12:34:53.425Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"127dcff986e975685cc553aa0edf0a9b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.442Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-06a359365c9f8bb349aeb5c7: done: 0.140362 sec","job_status":"done","queue_duration_s":2.583818,"scheduling_latency_s":2.583857,"redis_calls":12,"redis_duration_s":0.010471,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004549,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00221834,"exclusive_lock_hold_duration_s":0.015825640000000002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.140362,"completed_at":"2026-08-16T12:34:56.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 238.161191] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"af2de0c423f17acacf50e81b","created_at":"2026-08-16T12:34:53.490Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0390aa1226093711c0ed9dcd652fdf3d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.513Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-af2de0c423f17acacf50e81b: start","job_status":"start","queue_duration_s":2.659351,"scheduling_latency_s":2.659467}1266gitlab # [ 238.175754] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"af2de0c423f17acacf50e81b","created_at":"2026-08-16T12:34:53.490Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0390aa1226093711c0ed9dcd652fdf3d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.513Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-af2de0c423f17acacf50e81b: done: 0.211306 sec","job_status":"done","queue_duration_s":2.659351,"scheduling_latency_s":2.659467,"redis_calls":12,"redis_duration_s":0.009562,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001141,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.069,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0021921,"exclusive_lock_hold_duration_s":0.08751294,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.211306,"completed_at":"2026-08-16T12:34:56.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.07032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 238.221147] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cd020f75f2bb4bc1aafde743","created_at":"2026-08-16T12:34:53.535Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0c3a1046ce7491d5fcc7534d0593f40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.564Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cd020f75f2bb4bc1aafde743: start","job_status":"start","queue_duration_s":2.825847,"scheduling_latency_s":2.82601}1268gitlab # [ 238.235334] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cd020f75f2bb4bc1aafde743","created_at":"2026-08-16T12:34:53.535Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0c3a1046ce7491d5fcc7534d0593f40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.564Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cd020f75f2bb4bc1aafde743: done: 0.367996 sec","job_status":"done","queue_duration_s":2.825847,"scheduling_latency_s":2.82601,"redis_calls":14,"redis_duration_s":0.007023,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002127,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.076,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.255373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00109748,"exclusive_lock_hold_duration_s":0.29581134000000003,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.367996,"completed_at":"2026-08-16T12:34:56.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.10618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 238.281505] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a1bd3da127ee114dc4c24980","created_at":"2026-08-16T12:34:53.585Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2fdc07e9a9f626e80aefef6253195f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.615Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a1bd3da127ee114dc4c24980: start","job_status":"start","queue_duration_s":3.144703,"scheduling_latency_s":3.144726}1270gitlab # [ 238.296296] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.774Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1271gitlab # [ 238.299351] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a1bd3da127ee114dc4c24980","created_at":"2026-08-16T12:34:53.585Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2fdc07e9a9f626e80aefef6253195f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.615Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a1bd3da127ee114dc4c24980: done: 0.021559 sec","job_status":"done","queue_duration_s":3.144703,"scheduling_latency_s":3.144726,"redis_calls":10,"redis_duration_s":0.002957,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001018,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033236,"duration_s":0.021559,"completed_at":"2026-08-16T12:34:56.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 238.342519] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"50eb8c73d937858fd64f9fa2","created_at":"2026-08-16T12:34:53.702Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c63bbafa33555e53d08f362d69f75ce","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.736Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-50eb8c73d937858fd64f9fa2: start","job_status":"start","queue_duration_s":3.046758,"scheduling_latency_s":3.046776}1273gitlab # [ 238.357351] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.818Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"50eb8c73d937858fd64f9fa2","created_at":"2026-08-16T12:34:53.702Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c63bbafa33555e53d08f362d69f75ce","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.736Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-50eb8c73d937858fd64f9fa2: done: 0.034954 sec","job_status":"done","queue_duration_s":3.046758,"scheduling_latency_s":3.046776,"redis_calls":13,"redis_duration_s":0.00375,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000613,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001923,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0113369,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034954,"completed_at":"2026-08-16T12:34:56.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004638,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1274gitlab # [ 238.401554] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.820Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"6f7ae3f8820ef045d74bb8ad","created_at":"2026-08-16T12:34:53.828Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9e5b35305058aef3a6ea2c0e192a993","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.911Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-6f7ae3f8820ef045d74bb8ad: start","job_status":"start","queue_duration_s":2.908937,"scheduling_latency_s":2.908955}1275gitlab # [ 238.414963] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"6f7ae3f8820ef045d74bb8ad","created_at":"2026-08-16T12:34:53.828Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9e5b35305058aef3a6ea2c0e192a993","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T12:34:53.911Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-6f7ae3f8820ef045d74bb8ad: done: 0.020756 sec","job_status":"done","queue_duration_s":2.908937,"scheduling_latency_s":2.908955,"redis_calls":12,"redis_duration_s":0.002846,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00052,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032216,"duration_s":0.020756,"completed_at":"2026-08-16T12:34:56.840Z","load_balancing_strategy":"primary","db_duration_s":0.000695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 238.457510] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.842Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56434f6eb29bff839380bc68","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56434f6eb29bff839380bc68: start","job_status":"start","queue_duration_s":2.407377,"scheduling_latency_s":2.407397}1277gitlab # [ 238.470486] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.860Z","message":"No existing merge request to be cleaned up."}1278gitlab # [ 238.472167] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.876Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56434f6eb29bff839380bc68","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56434f6eb29bff839380bc68: done: 0.033727 sec","job_status":"done","queue_duration_s":2.407377,"scheduling_latency_s":2.407397,"redis_calls":13,"redis_duration_s":0.0038799999999999998,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003353,"duration_s":0.033727,"completed_at":"2026-08-16T12:34:56.876Z","load_balancing_strategy":"primary","db_duration_s":0.006055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 238.512554] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.877Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce265db713d460f55210742d","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce265db713d460f55210742d: start","job_status":"start","queue_duration_s":2.442756,"scheduling_latency_s":2.442773}1280gitlab # [ 238.524643] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.898Z","message":"No existing merge request to be cleaned up."}1281gitlab # [ 238.526247] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.919Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce265db713d460f55210742d","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce265db713d460f55210742d: done: 0.041121 sec","job_status":"done","queue_duration_s":2.442756,"scheduling_latency_s":2.442773,"redis_calls":10,"redis_duration_s":0.002848,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041121,"completed_at":"2026-08-16T12:34:56.918Z","load_balancing_strategy":"primary","db_duration_s":0.0128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 238.565099] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.922Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d83eb28887245535906d4946","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d83eb28887245535906d4946: start","job_status":"start","queue_duration_s":2.486938,"scheduling_latency_s":2.486978}1283gitlab # [ 238.577469] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.949Z","message":"No existing merge request to be cleaned up."}1284gitlab # [ 238.579169] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.967Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d83eb28887245535906d4946","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d83eb28887245535906d4946: done: 0.045932 sec","job_status":"done","queue_duration_s":2.486938,"scheduling_latency_s":2.486978,"redis_calls":10,"redis_duration_s":0.0036119999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045932,"completed_at":"2026-08-16T12:34:56.967Z","load_balancing_strategy":"primary","db_duration_s":0.003889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 238.617759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.970Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f1126f18b445a674997f829","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f1126f18b445a674997f829: start","job_status":"start","queue_duration_s":2.535529,"scheduling_latency_s":2.535564}1286gitlab # [ 238.630205] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:56.992Z","message":"No existing merge request to be cleaned up."}1287gitlab # [ 238.631840] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.008Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f1126f18b445a674997f829","created_at":"2026-08-16T12:34:54.400Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5e73fdea89a54822","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"38484a2bc960f0702a9c2570361bed49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:54.435Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f1126f18b445a674997f829: done: 0.038089 sec","job_status":"done","queue_duration_s":2.535529,"scheduling_latency_s":2.535564,"redis_calls":10,"redis_duration_s":0.003347,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038089,"completed_at":"2026-08-16T12:34:57.008Z","load_balancing_strategy":"primary","db_duration_s":0.002982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 238.670624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94d345726a2e3b6df157a2e5","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94d345726a2e3b6df157a2e5: start","job_status":"start","queue_duration_s":1.152043,"scheduling_latency_s":1.152072}1289gitlab # [ 238.683777] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94d345726a2e3b6df157a2e5","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94d345726a2e3b6df157a2e5: done: 0.035222 sec","job_status":"done","queue_duration_s":1.152043,"scheduling_latency_s":1.152072,"redis_calls":16,"redis_duration_s":0.004839,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002608,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043286,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035222,"completed_at":"2026-08-16T12:34:57.046Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 238.724904] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360b4bb0919b1d5f5d940f6d","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360b4bb0919b1d5f5d940f6d: start","job_status":"start","queue_duration_s":1.189259,"scheduling_latency_s":1.18928}1291gitlab # [ 238.737236] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360b4bb0919b1d5f5d940f6d","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360b4bb0919b1d5f5d940f6d: done: 0.020447 sec","job_status":"done","queue_duration_s":1.189259,"scheduling_latency_s":1.18928,"redis_calls":13,"redis_duration_s":0.003176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020447,"completed_at":"2026-08-16T12:34:57.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 238.776885] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66b6e1a3ea946fb23396180f","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66b6e1a3ea946fb23396180f: start","job_status":"start","queue_duration_s":1.211484,"scheduling_latency_s":1.211504}1293gitlab # [ 238.789060] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66b6e1a3ea946fb23396180f","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66b6e1a3ea946fb23396180f: done: 0.018526 sec","job_status":"done","queue_duration_s":1.211484,"scheduling_latency_s":1.211504,"redis_calls":13,"redis_duration_s":0.003253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018526,"completed_at":"2026-08-16T12:34:57.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 238.828270] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5cef4c69c07369cd6213a80","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5cef4c69c07369cd6213a80: start","job_status":"start","queue_duration_s":1.231745,"scheduling_latency_s":1.231765}1295gitlab # [ 238.840669] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5cef4c69c07369cd6213a80","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5cef4c69c07369cd6213a80: done: 0.017548 sec","job_status":"done","queue_duration_s":1.231745,"scheduling_latency_s":1.231765,"redis_calls":13,"redis_duration_s":0.003071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017548,"completed_at":"2026-08-16T12:34:57.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 238.880976] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e6e9867825025ca47da63e","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e6e9867825025ca47da63e: start","job_status":"start","queue_duration_s":1.251007,"scheduling_latency_s":1.251026}1297gitlab # [ 238.918536] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e6e9867825025ca47da63e","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e6e9867825025ca47da63e: done: 0.016771 sec","job_status":"done","queue_duration_s":1.251007,"scheduling_latency_s":1.251026,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016771,"completed_at":"2026-08-16T12:34:57.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 238.989866] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8068f2b52bed81262d689ce","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8068f2b52bed81262d689ce: start","job_status":"start","queue_duration_s":1.269379,"scheduling_latency_s":1.269396}1299gitlab # [ 239.004343] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8068f2b52bed81262d689ce","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8068f2b52bed81262d689ce: done: 0.016222 sec","job_status":"done","queue_duration_s":1.269379,"scheduling_latency_s":1.269396,"redis_calls":13,"redis_duration_s":0.0031010000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016222,"completed_at":"2026-08-16T12:34:57.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 239.045138] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f2f133d6e12ce0b6632e57","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f2f133d6e12ce0b6632e57: start","job_status":"start","queue_duration_s":1.287158,"scheduling_latency_s":1.287176}1301gitlab # [ 239.083706] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f2f133d6e12ce0b6632e57","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f2f133d6e12ce0b6632e57: done: 0.015786 sec","job_status":"done","queue_duration_s":1.287158,"scheduling_latency_s":1.287176,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015786,"completed_at":"2026-08-16T12:34:57.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 239.162952] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca7d349a22c1c61f19430b3","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca7d349a22c1c61f19430b3: start","job_status":"start","queue_duration_s":1.304164,"scheduling_latency_s":1.30418}1303gitlab # [ 239.178267] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca7d349a22c1c61f19430b3","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca7d349a22c1c61f19430b3: done: 0.016263 sec","job_status":"done","queue_duration_s":1.304164,"scheduling_latency_s":1.30418,"redis_calls":13,"redis_duration_s":0.003099,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016263,"completed_at":"2026-08-16T12:34:57.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 239.218672] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240961a0644787fafd1be775","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240961a0644787fafd1be775: start","job_status":"start","queue_duration_s":1.321764,"scheduling_latency_s":1.32178}1305gitlab # [ 239.231238] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240961a0644787fafd1be775","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240961a0644787fafd1be775: done: 0.015643 sec","job_status":"done","queue_duration_s":1.321764,"scheduling_latency_s":1.32178,"redis_calls":13,"redis_duration_s":0.002884,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015643,"completed_at":"2026-08-16T12:34:57.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 239.270759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34455da6a8087db2c69ec0e4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34455da6a8087db2c69ec0e4: start","job_status":"start","queue_duration_s":1.338951,"scheduling_latency_s":1.338967}1307gitlab # [ 239.283696] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34455da6a8087db2c69ec0e4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34455da6a8087db2c69ec0e4: done: 0.015782 sec","job_status":"done","queue_duration_s":1.338951,"scheduling_latency_s":1.338967,"redis_calls":13,"redis_duration_s":0.002679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015782,"completed_at":"2026-08-16T12:34:57.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 239.324278] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be8a2746e60f56d5a66383d2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be8a2746e60f56d5a66383d2: start","job_status":"start","queue_duration_s":1.356164,"scheduling_latency_s":1.35618}1309gitlab # [ 239.336638] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be8a2746e60f56d5a66383d2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be8a2746e60f56d5a66383d2: done: 0.016091 sec","job_status":"done","queue_duration_s":1.356164,"scheduling_latency_s":1.35618,"redis_calls":13,"redis_duration_s":0.002874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016091,"completed_at":"2026-08-16T12:34:57.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 239.376617] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81383524c9f2db390f06a01","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81383524c9f2db390f06a01: start","job_status":"start","queue_duration_s":1.373597,"scheduling_latency_s":1.373614}1311gitlab # [ 239.389103] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81383524c9f2db390f06a01","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81383524c9f2db390f06a01: done: 0.015953 sec","job_status":"done","queue_duration_s":1.373597,"scheduling_latency_s":1.373614,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015953,"completed_at":"2026-08-16T12:34:57.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 239.428811] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"044a5628ad4e3bba40dd635b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-044a5628ad4e3bba40dd635b: start","job_status":"start","queue_duration_s":1.391372,"scheduling_latency_s":1.391391}1313gitlab # [ 239.441181] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"044a5628ad4e3bba40dd635b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-044a5628ad4e3bba40dd635b: done: 0.015708 sec","job_status":"done","queue_duration_s":1.391372,"scheduling_latency_s":1.391391,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-08-16T12:34:57.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 239.480634] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3317b3f97144566c2d2b2cc0","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3317b3f97144566c2d2b2cc0: start","job_status":"start","queue_duration_s":1.408604,"scheduling_latency_s":1.408621}1315gitlab # [ 239.494153] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3317b3f97144566c2d2b2cc0","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3317b3f97144566c2d2b2cc0: done: 0.015695 sec","job_status":"done","queue_duration_s":1.408604,"scheduling_latency_s":1.408621,"redis_calls":13,"redis_duration_s":0.00294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015695,"completed_at":"2026-08-16T12:34:57.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 239.533803] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86e6b6d6db49ff46943497fb","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86e6b6d6db49ff46943497fb: start","job_status":"start","queue_duration_s":1.425793,"scheduling_latency_s":1.425809}1317gitlab # [ 239.546412] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86e6b6d6db49ff46943497fb","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86e6b6d6db49ff46943497fb: done: 0.016897 sec","job_status":"done","queue_duration_s":1.425793,"scheduling_latency_s":1.425809,"redis_calls":13,"redis_duration_s":0.002994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016897,"completed_at":"2026-08-16T12:34:57.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 239.586319] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4ce9ea1d67b3be1614dbda2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4ce9ea1d67b3be1614dbda2: start","job_status":"start","queue_duration_s":1.444429,"scheduling_latency_s":1.444449}1319gitlab # [ 239.598954] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4ce9ea1d67b3be1614dbda2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4ce9ea1d67b3be1614dbda2: done: 0.015634 sec","job_status":"done","queue_duration_s":1.444429,"scheduling_latency_s":1.444449,"redis_calls":13,"redis_duration_s":0.00263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015634,"completed_at":"2026-08-16T12:34:57.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 239.638659] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62054b56241d3682b5a4a2fc","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62054b56241d3682b5a4a2fc: start","job_status":"start","queue_duration_s":1.461535,"scheduling_latency_s":1.461551}1321gitlab # [ 239.651361] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62054b56241d3682b5a4a2fc","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62054b56241d3682b5a4a2fc: done: 0.015764 sec","job_status":"done","queue_duration_s":1.461535,"scheduling_latency_s":1.461551,"redis_calls":13,"redis_duration_s":0.0028919999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015764,"completed_at":"2026-08-16T12:34:57.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 239.691405] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8d6dad461b52513c7ae5f8","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8d6dad461b52513c7ae5f8: start","job_status":"start","queue_duration_s":1.478591,"scheduling_latency_s":1.478607}1323gitlab # [ 239.705006] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa8d6dad461b52513c7ae5f8","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa8d6dad461b52513c7ae5f8: done: 0.0161 sec","job_status":"done","queue_duration_s":1.478591,"scheduling_latency_s":1.478607,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0161,"completed_at":"2026-08-16T12:34:57.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 239.744586] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08fba0d93861552454b7c069","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08fba0d93861552454b7c069: start","job_status":"start","queue_duration_s":1.496053,"scheduling_latency_s":1.496069}1325gitlab # [ 239.756926] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08fba0d93861552454b7c069","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08fba0d93861552454b7c069: done: 0.016774 sec","job_status":"done","queue_duration_s":1.496053,"scheduling_latency_s":1.496069,"redis_calls":13,"redis_duration_s":0.002964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016774,"completed_at":"2026-08-16T12:34:57.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 239.797043] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c24c3ec69183a9ee1c6f300","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c24c3ec69183a9ee1c6f300: start","job_status":"start","queue_duration_s":1.514336,"scheduling_latency_s":1.514354}1327gitlab # [ 239.809609] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c24c3ec69183a9ee1c6f300","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c24c3ec69183a9ee1c6f300: done: 0.01739 sec","job_status":"done","queue_duration_s":1.514336,"scheduling_latency_s":1.514354,"redis_calls":13,"redis_duration_s":0.003182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01739,"completed_at":"2026-08-16T12:34:57.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 239.849309] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4ab9130735522d33c3ee19e","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4ab9130735522d33c3ee19e: start","job_status":"start","queue_duration_s":1.533296,"scheduling_latency_s":1.533317}1329gitlab # [ 239.861590] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4ab9130735522d33c3ee19e","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4ab9130735522d33c3ee19e: done: 0.017657 sec","job_status":"done","queue_duration_s":1.533296,"scheduling_latency_s":1.533317,"redis_calls":13,"redis_duration_s":0.002834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017657,"completed_at":"2026-08-16T12:34:57.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 239.902079] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c2e3638d41e8aebac852a6","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c2e3638d41e8aebac852a6: start","job_status":"start","queue_duration_s":1.552483,"scheduling_latency_s":1.552502}1331gitlab # [ 239.914813] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c2e3638d41e8aebac852a6","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c2e3638d41e8aebac852a6: done: 0.018098 sec","job_status":"done","queue_duration_s":1.552483,"scheduling_latency_s":1.552502,"redis_calls":13,"redis_duration_s":0.003027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018098,"completed_at":"2026-08-16T12:34:57.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 239.954589] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7326b495d9943dd49ba296","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7326b495d9943dd49ba296: start","job_status":"start","queue_duration_s":1.572703,"scheduling_latency_s":1.572724}1333gitlab # [ 239.967408] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7326b495d9943dd49ba296","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7326b495d9943dd49ba296: done: 0.032443 sec","job_status":"done","queue_duration_s":1.572703,"scheduling_latency_s":1.572724,"redis_calls":13,"redis_duration_s":0.003589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032443,"completed_at":"2026-08-16T12:34:57.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 240.007333] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0de40e03dcc13951afb5421","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0de40e03dcc13951afb5421: start","job_status":"start","queue_duration_s":1.609434,"scheduling_latency_s":1.609479}1335gitlab # [ 240.019946] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0de40e03dcc13951afb5421","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0de40e03dcc13951afb5421: done: 0.043251 sec","job_status":"done","queue_duration_s":1.609434,"scheduling_latency_s":1.609479,"redis_calls":13,"redis_duration_s":0.005175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003564,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043251,"completed_at":"2026-08-16T12:34:57.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 240.059927] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27dec78d6fc740cc85b9ee48","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27dec78d6fc740cc85b9ee48: start","job_status":"start","queue_duration_s":1.656345,"scheduling_latency_s":1.656389}1337gitlab # [ 240.072814] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27dec78d6fc740cc85b9ee48","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27dec78d6fc740cc85b9ee48: done: 0.037498 sec","job_status":"done","queue_duration_s":1.656345,"scheduling_latency_s":1.656389,"redis_calls":13,"redis_duration_s":0.006268999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037498,"completed_at":"2026-08-16T12:34:57.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 240.113184] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca13196c9a537df973a7a1cc","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca13196c9a537df973a7a1cc: start","job_status":"start","queue_duration_s":1.699639,"scheduling_latency_s":1.699673}1339gitlab # [ 240.125384] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca13196c9a537df973a7a1cc","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca13196c9a537df973a7a1cc: done: 0.02708 sec","job_status":"done","queue_duration_s":1.699639,"scheduling_latency_s":1.699673,"redis_calls":13,"redis_duration_s":0.004105,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02708,"completed_at":"2026-08-16T12:34:57.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 240.164398] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46870eeda234790851e0d4c1","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46870eeda234790851e0d4c1: start","job_status":"start","queue_duration_s":1.72922,"scheduling_latency_s":1.72925}1341gitlab # [ 240.176726] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46870eeda234790851e0d4c1","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46870eeda234790851e0d4c1: done: 0.024499 sec","job_status":"done","queue_duration_s":1.72922,"scheduling_latency_s":1.72925,"redis_calls":13,"redis_duration_s":0.003699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024499,"completed_at":"2026-08-16T12:34:57.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 240.215700] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718824dc95c5351597e85eb1","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718824dc95c5351597e85eb1: start","job_status":"start","queue_duration_s":1.755302,"scheduling_latency_s":1.755328}1343gitlab # [ 240.228481] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718824dc95c5351597e85eb1","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718824dc95c5351597e85eb1: done: 0.018588 sec","job_status":"done","queue_duration_s":1.755302,"scheduling_latency_s":1.755328,"redis_calls":13,"redis_duration_s":0.002846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018588,"completed_at":"2026-08-16T12:34:57.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 240.267922] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f5a47eef10729f56fa4f90","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f5a47eef10729f56fa4f90: start","job_status":"start","queue_duration_s":1.775487,"scheduling_latency_s":1.775512}1345gitlab # [ 240.280492] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f5a47eef10729f56fa4f90","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f5a47eef10729f56fa4f90: done: 0.017238 sec","job_status":"done","queue_duration_s":1.775487,"scheduling_latency_s":1.775512,"redis_calls":13,"redis_duration_s":0.0025900000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017238,"completed_at":"2026-08-16T12:34:57.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 240.321254] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22621351c88bbe4e3cddbc58","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22621351c88bbe4e3cddbc58: start","job_status":"start","queue_duration_s":1.794216,"scheduling_latency_s":1.794239}1347gitlab # [ 240.333759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22621351c88bbe4e3cddbc58","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22621351c88bbe4e3cddbc58: done: 0.016904 sec","job_status":"done","queue_duration_s":1.794216,"scheduling_latency_s":1.794239,"redis_calls":13,"redis_duration_s":0.00307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016904,"completed_at":"2026-08-16T12:34:57.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 240.372912] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8a70864f2a0a3837c35aff","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8a70864f2a0a3837c35aff: start","job_status":"start","queue_duration_s":1.812623,"scheduling_latency_s":1.812644}1349gitlab # [ 240.385073] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8a70864f2a0a3837c35aff","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8a70864f2a0a3837c35aff: done: 0.017732 sec","job_status":"done","queue_duration_s":1.812623,"scheduling_latency_s":1.812644,"redis_calls":13,"redis_duration_s":0.003298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017732,"completed_at":"2026-08-16T12:34:57.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 240.424478] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48287ce26c39de5b408c3bc9","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48287ce26c39de5b408c3bc9: start","job_status":"start","queue_duration_s":1.831954,"scheduling_latency_s":1.831975}1351gitlab # [ 240.436936] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48287ce26c39de5b408c3bc9","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48287ce26c39de5b408c3bc9: done: 0.016185 sec","job_status":"done","queue_duration_s":1.831954,"scheduling_latency_s":1.831975,"redis_calls":13,"redis_duration_s":0.0025789999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016185,"completed_at":"2026-08-16T12:34:57.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 240.476241] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e87037b73ed792b4c79583","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e87037b73ed792b4c79583: start","job_status":"start","queue_duration_s":1.849606,"scheduling_latency_s":1.849622}1353gitlab # [ 240.488681] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e87037b73ed792b4c79583","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e87037b73ed792b4c79583: done: 0.015528 sec","job_status":"done","queue_duration_s":1.849606,"scheduling_latency_s":1.849622,"redis_calls":13,"redis_duration_s":0.002644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015528,"completed_at":"2026-08-16T12:34:57.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 240.528744] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbbc10670909971ad3217ee","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbbc10670909971ad3217ee: start","job_status":"start","queue_duration_s":1.866763,"scheduling_latency_s":1.86678}1355gitlab # [ 240.540901] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbbc10670909971ad3217ee","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbbc10670909971ad3217ee: done: 0.015796 sec","job_status":"done","queue_duration_s":1.866763,"scheduling_latency_s":1.86678,"redis_calls":13,"redis_duration_s":0.002721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015796,"completed_at":"2026-08-16T12:34:57.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 240.580190] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f8b414df58cbbf6b0da02e2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f8b414df58cbbf6b0da02e2: start","job_status":"start","queue_duration_s":1.884188,"scheduling_latency_s":1.884204}1357gitlab # [ 240.592397] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f8b414df58cbbf6b0da02e2","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f8b414df58cbbf6b0da02e2: done: 0.015611 sec","job_status":"done","queue_duration_s":1.884188,"scheduling_latency_s":1.884204,"redis_calls":13,"redis_duration_s":0.002651,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015611,"completed_at":"2026-08-16T12:34:57.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 240.631441] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8eda7df3e200b3ade7cc337","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8eda7df3e200b3ade7cc337: start","job_status":"start","queue_duration_s":1.901326,"scheduling_latency_s":1.901341}1359gitlab # [ 240.644117] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8eda7df3e200b3ade7cc337","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8eda7df3e200b3ade7cc337: done: 0.015889 sec","job_status":"done","queue_duration_s":1.901326,"scheduling_latency_s":1.901341,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015889,"completed_at":"2026-08-16T12:34:57.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 240.683325] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"647e2b3a882ec38a9326acc9","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-647e2b3a882ec38a9326acc9: start","job_status":"start","queue_duration_s":1.918796,"scheduling_latency_s":1.918811}1361gitlab # [ 240.695850] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"647e2b3a882ec38a9326acc9","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-647e2b3a882ec38a9326acc9: done: 0.015578 sec","job_status":"done","queue_duration_s":1.918796,"scheduling_latency_s":1.918811,"redis_calls":13,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015578,"completed_at":"2026-08-16T12:34:57.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 240.736403] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baa1511e0b982472a227aecb","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baa1511e0b982472a227aecb: start","job_status":"start","queue_duration_s":1.935703,"scheduling_latency_s":1.935718}1363gitlab # [ 240.748550] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baa1511e0b982472a227aecb","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baa1511e0b982472a227aecb: done: 0.01546 sec","job_status":"done","queue_duration_s":1.935703,"scheduling_latency_s":1.935718,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01546,"completed_at":"2026-08-16T12:34:57.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 240.787772] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72fb9341d26ec79a12fbfb06","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72fb9341d26ec79a12fbfb06: start","job_status":"start","queue_duration_s":1.952784,"scheduling_latency_s":1.9528}1365gitlab # [ 240.800490] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72fb9341d26ec79a12fbfb06","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72fb9341d26ec79a12fbfb06: done: 0.015991 sec","job_status":"done","queue_duration_s":1.952784,"scheduling_latency_s":1.9528,"redis_calls":13,"redis_duration_s":0.003041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015991,"completed_at":"2026-08-16T12:34:57.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 240.839701] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9801f7a33d79bdf90a9771c4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9801f7a33d79bdf90a9771c4: start","job_status":"start","queue_duration_s":1.970046,"scheduling_latency_s":1.970061}1367gitlab # [ 240.852353] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9801f7a33d79bdf90a9771c4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9801f7a33d79bdf90a9771c4: done: 0.016671 sec","job_status":"done","queue_duration_s":1.970046,"scheduling_latency_s":1.970061,"redis_calls":13,"redis_duration_s":0.002894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016671,"completed_at":"2026-08-16T12:34:57.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 240.891681] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5c780238506c698148bdb83","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5c780238506c698148bdb83: start","job_status":"start","queue_duration_s":1.988235,"scheduling_latency_s":1.988252}1369gitlab # [ 240.904135] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5c780238506c698148bdb83","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5c780238506c698148bdb83: done: 0.015613 sec","job_status":"done","queue_duration_s":1.988235,"scheduling_latency_s":1.988252,"redis_calls":13,"redis_duration_s":0.002564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015613,"completed_at":"2026-08-16T12:34:57.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 240.944260] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1df6f80de259270259dc6b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1df6f80de259270259dc6b: start","job_status":"start","queue_duration_s":2.005215,"scheduling_latency_s":2.005229}1371gitlab # [ 240.956488] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1df6f80de259270259dc6b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1df6f80de259270259dc6b: done: 0.016082 sec","job_status":"done","queue_duration_s":2.005215,"scheduling_latency_s":2.005229,"redis_calls":13,"redis_duration_s":0.00282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016082,"completed_at":"2026-08-16T12:34:57.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 240.995583] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:57.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"172fa5569f02bb77d4e3d85b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-172fa5569f02bb77d4e3d85b: start","job_status":"start","queue_duration_s":2.027968,"scheduling_latency_s":2.027984}1373gitlab # [ 241.008362] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"172fa5569f02bb77d4e3d85b","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-172fa5569f02bb77d4e3d85b: done: 0.419915 sec","job_status":"done","queue_duration_s":2.027968,"scheduling_latency_s":2.027984,"redis_calls":13,"redis_duration_s":0.005785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.419915,"completed_at":"2026-08-16T12:34:58.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 241.047462] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10bb2e2ebf4ffb6659101074","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10bb2e2ebf4ffb6659101074: start","job_status":"start","queue_duration_s":2.450537,"scheduling_latency_s":2.450571}1375gitlab # [ 241.059889] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10bb2e2ebf4ffb6659101074","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10bb2e2ebf4ffb6659101074: done: 0.029609 sec","job_status":"done","queue_duration_s":2.450537,"scheduling_latency_s":2.450571,"redis_calls":13,"redis_duration_s":0.00497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029609,"completed_at":"2026-08-16T12:34:58.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 241.099400] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bae2c6cc1f9b6999cdc3727f","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bae2c6cc1f9b6999cdc3727f: start","job_status":"start","queue_duration_s":2.482283,"scheduling_latency_s":2.482309}1377gitlab # [ 241.112371] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bae2c6cc1f9b6999cdc3727f","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bae2c6cc1f9b6999cdc3727f: done: 0.025072 sec","job_status":"done","queue_duration_s":2.482283,"scheduling_latency_s":2.482309,"redis_calls":13,"redis_duration_s":0.0034990000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025072,"completed_at":"2026-08-16T12:34:58.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 241.152411] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80bf2e9a157ae1bf10d2af65","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80bf2e9a157ae1bf10d2af65: start","job_status":"start","queue_duration_s":2.508989,"scheduling_latency_s":2.509008}1379gitlab # [ 241.164825] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80bf2e9a157ae1bf10d2af65","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80bf2e9a157ae1bf10d2af65: done: 0.020171 sec","job_status":"done","queue_duration_s":2.508989,"scheduling_latency_s":2.509008,"redis_calls":13,"redis_duration_s":0.0031869999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020171,"completed_at":"2026-08-16T12:34:58.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 241.204237] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d789316889887248c74bce","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d789316889887248c74bce: start","job_status":"start","queue_duration_s":2.531831,"scheduling_latency_s":2.531851}1381gitlab # [ 241.216312] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d789316889887248c74bce","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d789316889887248c74bce: done: 0.018177 sec","job_status":"done","queue_duration_s":2.531831,"scheduling_latency_s":2.531851,"redis_calls":13,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018177,"completed_at":"2026-08-16T12:34:58.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 241.255937] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac7dd42331b348abb787fa95","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac7dd42331b348abb787fa95: start","job_status":"start","queue_duration_s":2.551579,"scheduling_latency_s":2.551597}1383gitlab # [ 241.268563] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac7dd42331b348abb787fa95","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac7dd42331b348abb787fa95: done: 0.017483 sec","job_status":"done","queue_duration_s":2.551579,"scheduling_latency_s":2.551597,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017483,"completed_at":"2026-08-16T12:34:58.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 241.307557] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"603316d17e7543389a379668","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-603316d17e7543389a379668: start","job_status":"start","queue_duration_s":2.570514,"scheduling_latency_s":2.570532}1385gitlab # [ 241.320206] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"603316d17e7543389a379668","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-603316d17e7543389a379668: done: 0.017242 sec","job_status":"done","queue_duration_s":2.570514,"scheduling_latency_s":2.570532,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017242,"completed_at":"2026-08-16T12:34:58.446Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 241.360782] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8546d1085582fe375bb809f4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8546d1085582fe375bb809f4: start","job_status":"start","queue_duration_s":2.589108,"scheduling_latency_s":2.589125}1387gitlab # [ 241.373233] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:34:58.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8546d1085582fe375bb809f4","created_at":"2026-08-16T12:34:55.727Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-5702d3877bfe48e6","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c70c6eb77851a1fa3b505fb3ba51d77b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:34:55.859Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8546d1085582fe375bb809f4: done: 0.015845 sec","job_status":"done","queue_duration_s":2.589108,"scheduling_latency_s":2.589125,"redis_calls":13,"redis_duration_s":0.002898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015845,"completed_at":"2026-08-16T12:34:58.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 241.543036] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d3e8abe2fcfd7b33593540d0","created_at":"2026-08-16T12:35:02.405Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37f58b6a09b2b7be8f32d7ce8d559fec","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.422Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d3e8abe2fcfd7b33593540d0: start","job_status":"start","queue_duration_s":0.004931,"scheduling_latency_s":0.004992}1389gitlab # [ 241.644244] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d3e8abe2fcfd7b33593540d0","created_at":"2026-08-16T12:35:02.405Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37f58b6a09b2b7be8f32d7ce8d559fec","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.422Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d3e8abe2fcfd7b33593540d0: done: 0.095959 sec","job_status":"done","queue_duration_s":0.004931,"scheduling_latency_s":0.004992,"redis_calls":7,"redis_duration_s":0.002822,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.095959,"completed_at":"2026-08-16T12:35:02.523Z","load_balancing_strategy":"primary","db_duration_s":0.031705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 241.735358] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c91dec0f7a40bcfd193cd713","created_at":"2026-08-16T12:35:02.437Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d144a0b6544bc31eadf93e4ce327d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.443Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c91dec0f7a40bcfd193cd713: start","job_status":"start","queue_duration_s":0.107761,"scheduling_latency_s":0.107811}1391gitlab # [ 241.787193] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c91dec0f7a40bcfd193cd713","created_at":"2026-08-16T12:35:02.437Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d144a0b6544bc31eadf93e4ce327d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.443Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c91dec0f7a40bcfd193cd713: done: 0.120613 sec","job_status":"done","queue_duration_s":0.107761,"scheduling_latency_s":0.107811,"redis_calls":7,"redis_duration_s":0.041451,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.035114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120613,"completed_at":"2026-08-16T12:35:02.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 241.857798] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"344dd2c935677f219782c648","created_at":"2026-08-16T12:35:02.496Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a93d6b22bed02f2b5cfe8ef394162e56","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.511Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-344dd2c935677f219782c648: start","job_status":"start","queue_duration_s":0.186507,"scheduling_latency_s":0.186556}1393gitlab # [ 241.964519] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"344dd2c935677f219782c648","created_at":"2026-08-16T12:35:02.496Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a93d6b22bed02f2b5cfe8ef394162e56","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.511Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-344dd2c935677f219782c648: done: 0.151185 sec","job_status":"done","queue_duration_s":0.186507,"scheduling_latency_s":0.186556,"redis_calls":7,"redis_duration_s":0.029039000000000002,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.026439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.151185,"completed_at":"2026-08-16T12:35:02.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 242.049853] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"74333459aeb75f62cd6fde6e","created_at":"2026-08-16T12:35:02.547Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df22b6ddcbba5483b97de6ce19e9447","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.557Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-74333459aeb75f62cd6fde6e: start","job_status":"start","queue_duration_s":0.321669,"scheduling_latency_s":0.32172}1395gitlab # [ 242.075813] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"74333459aeb75f62cd6fde6e","created_at":"2026-08-16T12:35:02.547Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df22b6ddcbba5483b97de6ce19e9447","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.557Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-74333459aeb75f62cd6fde6e: done: 0.080618 sec","job_status":"done","queue_duration_s":0.321669,"scheduling_latency_s":0.32172,"redis_calls":9,"redis_duration_s":0.008203,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00122356,"exclusive_lock_hold_duration_s":0.02674964,"duration_s":0.080618,"completed_at":"2026-08-16T12:35:02.959Z","load_balancing_strategy":"primary","db_duration_s":0.021418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 242.134425] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:02.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d9665bafdf330b0bf9b50488","created_at":"2026-08-16T12:35:02.597Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f8d7f5296ef8b8e806a961c93e0adc4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.603Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d9665bafdf330b0bf9b50488: start","job_status":"start","queue_duration_s":0.360187,"scheduling_latency_s":0.360228}1397gitlab # [ 242.174842] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.055Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1398gitlab # [ 242.201014] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d9665bafdf330b0bf9b50488","created_at":"2026-08-16T12:35:02.597Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f8d7f5296ef8b8e806a961c93e0adc4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.603Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d9665bafdf330b0bf9b50488: done: 0.12181 sec","job_status":"done","queue_duration_s":0.360187,"scheduling_latency_s":0.360228,"redis_calls":7,"redis_duration_s":0.003844,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.12181,"completed_at":"2026-08-16T12:35:03.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 242.277906] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"56c4b8f68d1921fefc5091b0","created_at":"2026-08-16T12:35:02.646Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd2d2f86b38cba749f5ab2153b361449","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.659Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-56c4b8f68d1921fefc5091b0: start","job_status":"start","queue_duration_s":0.464112,"scheduling_latency_s":0.464158}1400gitlab # [ 242.294526] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.159Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1401gitlab # [ 242.302106] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"56c4b8f68d1921fefc5091b0","created_at":"2026-08-16T12:35:02.646Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd2d2f86b38cba749f5ab2153b361449","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.659Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-56c4b8f68d1921fefc5091b0: done: 0.063797 sec","job_status":"done","queue_duration_s":0.464112,"scheduling_latency_s":0.464158,"redis_calls":7,"redis_duration_s":0.002655,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063797,"completed_at":"2026-08-16T12:35:03.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 242.344387] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"423f933bf6ede64e19cbfe5c","created_at":"2026-08-16T12:35:02.696Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b76f7cf145f5863e86a647563dfece","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.706Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-423f933bf6ede64e19cbfe5c: start","job_status":"start","queue_duration_s":0.484191,"scheduling_latency_s":0.484245}1403gitlab # [ 242.471405] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"423f933bf6ede64e19cbfe5c","created_at":"2026-08-16T12:35:02.696Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1b76f7cf145f5863e86a647563dfece","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.706Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-423f933bf6ede64e19cbfe5c: done: 0.163747 sec","job_status":"done","queue_duration_s":0.484191,"scheduling_latency_s":0.484245,"redis_calls":7,"redis_duration_s":0.05613,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.05336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.163747,"completed_at":"2026-08-16T12:35:03.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 242.558988] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d364e42552e463c068e4326","created_at":"2026-08-16T12:35:02.747Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01fec7181af22a846c2a148efc71adc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:35:02.754Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d364e42552e463c068e4326: start","job_status":"start","queue_duration_s":0.609767,"scheduling_latency_s":0.609811}1405gitlab # [ 242.581059] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.392Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1406gitlab # [ 242.586581] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d364e42552e463c068e4326","created_at":"2026-08-16T12:35:02.747Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01fec7181af22a846c2a148efc71adc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:35:02.754Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d364e42552e463c068e4326: done: 0.040684 sec","job_status":"done","queue_duration_s":0.609767,"scheduling_latency_s":0.609811,"redis_calls":7,"redis_duration_s":0.003064,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040684,"completed_at":"2026-08-16T12:35:03.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 242.636135] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ddaee752089afef073556605","created_at":"2026-08-16T12:35:02.775Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"882c0327e969ef38d03220a4a21fee08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:35:02.782Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ddaee752089afef073556605: start","job_status":"start","queue_duration_s":0.626576,"scheduling_latency_s":0.626613}1408gitlab # [ 242.649334] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.479Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ddaee752089afef073556605","created_at":"2026-08-16T12:35:02.775Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"882c0327e969ef38d03220a4a21fee08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:35:02.782Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ddaee752089afef073556605: done: 0.069984 sec","job_status":"done","queue_duration_s":0.626576,"scheduling_latency_s":0.626613,"redis_calls":7,"redis_duration_s":0.0104,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009455,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069984,"completed_at":"2026-08-16T12:35:03.478Z","load_balancing_strategy":"primary","db_duration_s":0.018097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 242.688634] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"976ec974d49640feb7c1b200","created_at":"2026-08-16T12:35:02.790Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d248d518ac7de58b08024eb48d88177e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.797Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-976ec974d49640feb7c1b200: start","job_status":"start","queue_duration_s":0.684642,"scheduling_latency_s":0.684681}1410gitlab # [ 242.702821] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.498Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1411gitlab # [ 242.706403] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"976ec974d49640feb7c1b200","created_at":"2026-08-16T12:35:02.790Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d248d518ac7de58b08024eb48d88177e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.797Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-976ec974d49640feb7c1b200: done: 0.026548 sec","job_status":"done","queue_duration_s":0.684642,"scheduling_latency_s":0.684681,"redis_calls":7,"redis_duration_s":0.002831,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026548,"completed_at":"2026-08-16T12:35:03.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 242.746779] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e755d96fccffbe98bc691386","created_at":"2026-08-16T12:35:02.806Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.817Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e755d96fccffbe98bc691386: start","job_status":"start","queue_duration_s":0.69391,"scheduling_latency_s":0.693937}1413gitlab # [ 242.761428] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e755d96fccffbe98bc691386","created_at":"2026-08-16T12:35:02.806Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.817Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e755d96fccffbe98bc691386: done: 0.03384 sec","job_status":"done","queue_duration_s":0.69391,"scheduling_latency_s":0.693937,"redis_calls":14,"redis_duration_s":0.003865,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.00033,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002379,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03384,"completed_at":"2026-08-16T12:35:03.544Z","load_balancing_strategy":"primary","db_duration_s":0.000897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 242.802319] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"577e19d98011abe36a86bc1e","created_at":"2026-08-16T12:35:02.837Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28919f15efd1114fd3c1430abeaeb9a6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.844Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-577e19d98011abe36a86bc1e: start","job_status":"start","queue_duration_s":0.702394,"scheduling_latency_s":0.702413}1415gitlab # [ 242.982979] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"577e19d98011abe36a86bc1e","created_at":"2026-08-16T12:35:02.837Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28919f15efd1114fd3c1430abeaeb9a6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.844Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-577e19d98011abe36a86bc1e: done: 0.321263 sec","job_status":"done","queue_duration_s":0.702394,"scheduling_latency_s":0.702413,"redis_calls":562,"redis_duration_s":0.065902,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.064718,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.292335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.321263,"completed_at":"2026-08-16T12:35:03.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 243.035377] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9c9af14595a0acce15486338","created_at":"2026-08-16T12:35:02.878Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b847833a9d0d808d47bbca6b1c764283","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:35:02.884Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9c9af14595a0acce15486338: start","job_status":"start","queue_duration_s":0.98486,"scheduling_latency_s":0.984878}1417gitlab # [ 243.048992] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.877Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1418gitlab # [ 243.052540] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9c9af14595a0acce15486338","created_at":"2026-08-16T12:35:02.878Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b847833a9d0d808d47bbca6b1c764283","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:35:02.884Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9c9af14595a0acce15486338: done: 0.013051 sec","job_status":"done","queue_duration_s":0.98486,"scheduling_latency_s":0.984878,"redis_calls":7,"redis_duration_s":0.001641,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013051,"completed_at":"2026-08-16T12:35:03.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 243.091867] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"cff2fe34c731853c5371e5fb","created_at":"2026-08-16T12:35:02.934Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43f43b20c80553040fea708c9ca0fa89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.948Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-cff2fe34c731853c5371e5fb: start","job_status":"start","queue_duration_s":0.935883,"scheduling_latency_s":0.936217}1420gitlab # [ 243.106633] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"cff2fe34c731853c5371e5fb","created_at":"2026-08-16T12:35:02.934Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43f43b20c80553040fea708c9ca0fa89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:02.948Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-cff2fe34c731853c5371e5fb: done: 0.049673 sec","job_status":"done","queue_duration_s":0.935883,"scheduling_latency_s":0.936217,"redis_calls":9,"redis_duration_s":0.002688,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0013,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054636,"exclusive_lock_hold_duration_s":0.03396538,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.049673,"completed_at":"2026-08-16T12:35:03.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 243.149601] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:03.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b00bf439413e2be580427826","created_at":"2026-08-16T12:35:03.015Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.020Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b00bf439413e2be580427826: start","job_status":"start","queue_duration_s":0.915479,"scheduling_latency_s":0.915497}1422gitlab # [ 243.163285] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b00bf439413e2be580427826","created_at":"2026-08-16T12:35:03.015Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.020Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b00bf439413e2be580427826: done: 0.092533 sec","job_status":"done","queue_duration_s":0.915479,"scheduling_latency_s":0.915497,"redis_calls":60,"redis_duration_s":0.014587,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000749,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013096,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092533,"completed_at":"2026-08-16T12:35:04.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 243.205714] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"235976da950f8d24411fb248","created_at":"2026-08-16T12:35:03.029Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5192ffd2c6bd0204ac9f782c7f9bd620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.033Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-235976da950f8d24411fb248: start","job_status":"start","queue_duration_s":0.996621,"scheduling_latency_s":0.996638}1424gitlab # [ 243.220235] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"235976da950f8d24411fb248","created_at":"2026-08-16T12:35:03.029Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5192ffd2c6bd0204ac9f782c7f9bd620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.033Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-235976da950f8d24411fb248: done: 0.013158 sec","job_status":"done","queue_duration_s":0.996621,"scheduling_latency_s":0.996638,"redis_calls":7,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013158,"completed_at":"2026-08-16T12:35:04.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 243.260965] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.044Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ff3d9393ab797102b3fabe30","created_at":"2026-08-16T12:35:03.069Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfb6e7ae26fb0c2d8207d7d97e74ba66","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.079Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ff3d9393ab797102b3fabe30: start","job_status":"start","queue_duration_s":0.964754,"scheduling_latency_s":0.96477}1426gitlab # [ 243.274926] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ff3d9393ab797102b3fabe30","created_at":"2026-08-16T12:35:03.069Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfb6e7ae26fb0c2d8207d7d97e74ba66","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.079Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ff3d9393ab797102b3fabe30: done: 0.025866 sec","job_status":"done","queue_duration_s":0.964754,"scheduling_latency_s":0.96477,"redis_calls":9,"redis_duration_s":0.003107,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00082474,"exclusive_lock_hold_duration_s":0.00329872,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025866,"completed_at":"2026-08-16T12:35:04.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 243.316579] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"a78ed0c0770a5657603b44fc","created_at":"2026-08-16T12:35:03.125Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a256157a4024943d4debb7bec53e9c8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.138Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-a78ed0c0770a5657603b44fc: start","job_status":"start","queue_duration_s":0.935361,"scheduling_latency_s":0.935408}1428gitlab # [ 243.330670] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"a78ed0c0770a5657603b44fc","created_at":"2026-08-16T12:35:03.125Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a256157a4024943d4debb7bec53e9c8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.138Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-a78ed0c0770a5657603b44fc: done: 0.048496 sec","job_status":"done","queue_duration_s":0.935361,"scheduling_latency_s":0.935408,"redis_calls":11,"redis_duration_s":0.003462,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000467,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000625,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055232,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.048496,"completed_at":"2026-08-16T12:35:04.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 243.374634] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"815244439d35a1b6ff05f38d","created_at":"2026-08-16T12:35:03.178Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d7de0021b3a9635ba4a564626e8ee80","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.185Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-815244439d35a1b6ff05f38d: start","job_status":"start","queue_duration_s":0.940033,"scheduling_latency_s":0.940065}1430gitlab # [ 243.390808] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"815244439d35a1b6ff05f38d","created_at":"2026-08-16T12:35:03.178Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d7de0021b3a9635ba4a564626e8ee80","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.185Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-815244439d35a1b6ff05f38d: done: 0.071223 sec","job_status":"done","queue_duration_s":0.940033,"scheduling_latency_s":0.940065,"redis_calls":9,"redis_duration_s":0.003906,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00130974,"exclusive_lock_hold_duration_s":0.0276467,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071223,"completed_at":"2026-08-16T12:35:04.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 243.433965] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7eb6eb9b11fa5fab3ae9667b","created_at":"2026-08-16T12:35:03.203Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9be7817fc47823775111f994df12528c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.209Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7eb6eb9b11fa5fab3ae9667b: start","job_status":"start","queue_duration_s":0.99101,"scheduling_latency_s":0.991048}1432gitlab # [ 243.636832] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7eb6eb9b11fa5fab3ae9667b","created_at":"2026-08-16T12:35:03.203Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9be7817fc47823775111f994df12528c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.209Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7eb6eb9b11fa5fab3ae9667b: done: 0.320368 sec","job_status":"done","queue_duration_s":0.99101,"scheduling_latency_s":0.991048,"redis_calls":9,"redis_duration_s":0.002827,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.256474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009406,"exclusive_lock_hold_duration_s":0.29547216,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.320368,"completed_at":"2026-08-16T12:35:04.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 243.733026] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"61241cfe6176681d55ce195b","created_at":"2026-08-16T12:35:03.216Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9974d0fd55c090adf02e3fd4eab99770","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.222Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-61241cfe6176681d55ce195b: start","job_status":"start","queue_duration_s":1.299886,"scheduling_latency_s":1.299902}1434gitlab # [ 243.755049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.529Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1435gitlab # [ 243.759445] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"61241cfe6176681d55ce195b","created_at":"2026-08-16T12:35:03.216Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9974d0fd55c090adf02e3fd4eab99770","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.222Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-61241cfe6176681d55ce195b: done: 0.01271 sec","job_status":"done","queue_duration_s":1.299886,"scheduling_latency_s":1.299902,"redis_calls":7,"redis_duration_s":0.001642,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01271,"completed_at":"2026-08-16T12:35:04.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 243.804842] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"bb479f4ebdc3c424abcb5eb7","created_at":"2026-08-16T12:35:03.246Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f680b52841aecd36bdd5076daaa1765d","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.258Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-bb479f4ebdc3c424abcb5eb7: start","job_status":"start","queue_duration_s":1.277146,"scheduling_latency_s":1.277162}1437gitlab # [ 243.819520] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"bb479f4ebdc3c424abcb5eb7","created_at":"2026-08-16T12:35:03.246Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f680b52841aecd36bdd5076daaa1765d","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.258Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-bb479f4ebdc3c424abcb5eb7: done: 0.031069 sec","job_status":"done","queue_duration_s":1.277146,"scheduling_latency_s":1.277162,"redis_calls":10,"redis_duration_s":0.002633,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004574,"duration_s":0.031069,"completed_at":"2026-08-16T12:35:04.567Z","load_balancing_strategy":"primary","db_duration_s":0.007817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 243.862788] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d04d322df74147056e2db2a9","created_at":"2026-08-16T12:35:03.333Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6d3aea687022881dde6150d6b96d99b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.349Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d04d322df74147056e2db2a9: start","job_status":"start","queue_duration_s":1.219498,"scheduling_latency_s":1.219514}1439gitlab # [ 243.877633] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d04d322df74147056e2db2a9","created_at":"2026-08-16T12:35:03.333Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6d3aea687022881dde6150d6b96d99b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.349Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d04d322df74147056e2db2a9: done: 0.020837 sec","job_status":"done","queue_duration_s":1.219498,"scheduling_latency_s":1.219514,"redis_calls":10,"redis_duration_s":0.00278,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00454644,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020837,"completed_at":"2026-08-16T12:35:04.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002338,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1440gitlab # [ 243.920347] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"a333e42c4effe27c2f406384","created_at":"2026-08-16T12:35:03.362Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1373e7f2c4e75bf95ed7411bce8435fd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.426Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-a333e42c4effe27c2f406384: start","job_status":"start","queue_duration_s":1.16449,"scheduling_latency_s":1.164508}1441gitlab # [ 243.934701] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"a333e42c4effe27c2f406384","created_at":"2026-08-16T12:35:03.362Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1373e7f2c4e75bf95ed7411bce8435fd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.426Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-a333e42c4effe27c2f406384: done: 0.184585 sec","job_status":"done","queue_duration_s":1.16449,"scheduling_latency_s":1.164508,"redis_calls":12,"redis_duration_s":0.003453,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000534,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.155453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065598,"exclusive_lock_hold_duration_s":0.16496942,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.184585,"completed_at":"2026-08-16T12:35:04.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024268,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1442gitlab # [ 243.979003] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.777Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26596aef194dff70f64119c7","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26596aef194dff70f64119c7: start","job_status":"start","queue_duration_s":1.239117,"scheduling_latency_s":1.239134}1443gitlab # [ 243.991933] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.788Z","message":"No existing merge request to be cleaned up."}1444gitlab # [ 243.993771] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.797Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26596aef194dff70f64119c7","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26596aef194dff70f64119c7: done: 0.020063 sec","job_status":"done","queue_duration_s":1.239117,"scheduling_latency_s":1.239134,"redis_calls":10,"redis_duration_s":0.002522,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001473,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020063,"completed_at":"2026-08-16T12:35:04.797Z","load_balancing_strategy":"primary","db_duration_s":0.002641,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 244.033760] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.798Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"493a4aabcb2a6ff77b05079d","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-493a4aabcb2a6ff77b05079d: start","job_status":"start","queue_duration_s":1.260776,"scheduling_latency_s":1.260793}1446gitlab # [ 244.045998] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.809Z","message":"No existing merge request to be cleaned up."}1447gitlab # [ 244.047652] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.818Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"493a4aabcb2a6ff77b05079d","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-493a4aabcb2a6ff77b05079d: done: 0.019756 sec","job_status":"done","queue_duration_s":1.260776,"scheduling_latency_s":1.260793,"redis_calls":10,"redis_duration_s":0.002591,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019756,"completed_at":"2026-08-16T12:35:04.818Z","load_balancing_strategy":"primary","db_duration_s":0.002581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 244.086569] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.820Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8a88e7c2e8aa43e999504424","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8a88e7c2e8aa43e999504424: start","job_status":"start","queue_duration_s":1.281916,"scheduling_latency_s":1.281931}1449gitlab # [ 244.099093] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.830Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 244.100811] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.838Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8a88e7c2e8aa43e999504424","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8a88e7c2e8aa43e999504424: done: 0.018988 sec","job_status":"done","queue_duration_s":1.281916,"scheduling_latency_s":1.281931,"redis_calls":10,"redis_duration_s":0.002405,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018988,"completed_at":"2026-08-16T12:35:04.838Z","load_balancing_strategy":"primary","db_duration_s":0.002384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 244.139518] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.840Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acfb41dc0a64120fa5ea480c","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acfb41dc0a64120fa5ea480c: start","job_status":"start","queue_duration_s":1.302318,"scheduling_latency_s":1.302334}1452gitlab # [ 244.152145] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.851Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 244.153775] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.861Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acfb41dc0a64120fa5ea480c","created_at":"2026-08-16T12:35:03.526Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-e9536a8af209472c","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"12f3df30f0f4529c4b9d5ca0afb06a49","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:03.538Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acfb41dc0a64120fa5ea480c: done: 0.021381 sec","job_status":"done","queue_duration_s":1.302318,"scheduling_latency_s":1.302334,"redis_calls":10,"redis_duration_s":0.002591,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021381,"completed_at":"2026-08-16T12:35:04.861Z","load_balancing_strategy":"primary","db_duration_s":0.00399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 244.192318] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9560cd470f97acab06517bf6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9560cd470f97acab06517bf6: start","job_status":"start","queue_duration_s":0.841699,"scheduling_latency_s":0.841718}1455gitlab # [ 244.204710] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9560cd470f97acab06517bf6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9560cd470f97acab06517bf6: done: 0.01516 sec","job_status":"done","queue_duration_s":0.841699,"scheduling_latency_s":0.841718,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01516,"completed_at":"2026-08-16T12:35:04.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 244.245404] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1ec6053c1e275b6950ea24","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1ec6053c1e275b6950ea24: start","job_status":"start","queue_duration_s":0.858004,"scheduling_latency_s":0.858021}1457gitlab # [ 244.257680] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1ec6053c1e275b6950ea24","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1ec6053c1e275b6950ea24: done: 0.014792 sec","job_status":"done","queue_duration_s":0.858004,"scheduling_latency_s":0.858021,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014792,"completed_at":"2026-08-16T12:35:04.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 244.296748] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae975c21f7c01c40570455f5","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae975c21f7c01c40570455f5: start","job_status":"start","queue_duration_s":0.87414,"scheduling_latency_s":0.874157}1459gitlab # [ 244.309191] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae975c21f7c01c40570455f5","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae975c21f7c01c40570455f5: done: 0.013973 sec","job_status":"done","queue_duration_s":0.87414,"scheduling_latency_s":0.874157,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013973,"completed_at":"2026-08-16T12:35:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 244.348631] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7ca47243ac08ed2e15d12b3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7ca47243ac08ed2e15d12b3: start","job_status":"start","queue_duration_s":0.889215,"scheduling_latency_s":0.889231}1461gitlab # [ 244.361039] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7ca47243ac08ed2e15d12b3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7ca47243ac08ed2e15d12b3: done: 0.014055 sec","job_status":"done","queue_duration_s":0.889215,"scheduling_latency_s":0.889231,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014055,"completed_at":"2026-08-16T12:35:04.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 244.400462] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbf8e22b67c4e247bbab3864","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbf8e22b67c4e247bbab3864: start","job_status":"start","queue_duration_s":0.904403,"scheduling_latency_s":0.90442}1463gitlab # [ 244.413603] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbf8e22b67c4e247bbab3864","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbf8e22b67c4e247bbab3864: done: 0.014147 sec","job_status":"done","queue_duration_s":0.904403,"scheduling_latency_s":0.90442,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014147,"completed_at":"2026-08-16T12:35:04.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 244.452755] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4353626662d0fb8d42ee93a4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4353626662d0fb8d42ee93a4: start","job_status":"start","queue_duration_s":0.919602,"scheduling_latency_s":0.919619}1465gitlab # [ 244.465144] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4353626662d0fb8d42ee93a4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4353626662d0fb8d42ee93a4: done: 0.013891 sec","job_status":"done","queue_duration_s":0.919602,"scheduling_latency_s":0.919619,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013891,"completed_at":"2026-08-16T12:35:04.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 244.504623] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02c2af86f2e76861d4133e2","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02c2af86f2e76861d4133e2: start","job_status":"start","queue_duration_s":0.934551,"scheduling_latency_s":0.934567}1467gitlab # [ 244.517080] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02c2af86f2e76861d4133e2","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02c2af86f2e76861d4133e2: done: 0.014288 sec","job_status":"done","queue_duration_s":0.934551,"scheduling_latency_s":0.934567,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014288,"completed_at":"2026-08-16T12:35:04.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 244.556484] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ab42cf2ad87acc365d451b","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ab42cf2ad87acc365d451b: start","job_status":"start","queue_duration_s":0.949944,"scheduling_latency_s":0.949961}1469gitlab # [ 244.568772] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3ab42cf2ad87acc365d451b","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3ab42cf2ad87acc365d451b: done: 0.013915 sec","job_status":"done","queue_duration_s":0.949944,"scheduling_latency_s":0.949961,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013915,"completed_at":"2026-08-16T12:35:04.985Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 244.608208] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:04.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455555a9ddeb73e899a56339","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455555a9ddeb73e899a56339: start","job_status":"start","queue_duration_s":0.964973,"scheduling_latency_s":0.96499}1471gitlab # [ 244.621399] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455555a9ddeb73e899a56339","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455555a9ddeb73e899a56339: done: 0.013814 sec","job_status":"done","queue_duration_s":0.964973,"scheduling_latency_s":0.96499,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013814,"completed_at":"2026-08-16T12:35:05.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 244.660801] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361794cf1fd4038ccda136d7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361794cf1fd4038ccda136d7: start","job_status":"start","queue_duration_s":0.979811,"scheduling_latency_s":0.979826}1473gitlab # [ 244.673315] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361794cf1fd4038ccda136d7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361794cf1fd4038ccda136d7: done: 0.014001 sec","job_status":"done","queue_duration_s":0.979811,"scheduling_latency_s":0.979826,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014001,"completed_at":"2026-08-16T12:35:05.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 244.712823] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f7708dc6343d321cf54b2b","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f7708dc6343d321cf54b2b: start","job_status":"start","queue_duration_s":0.99489,"scheduling_latency_s":0.994906}1475gitlab # [ 244.725282] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f7708dc6343d321cf54b2b","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f7708dc6343d321cf54b2b: done: 0.013955 sec","job_status":"done","queue_duration_s":0.99489,"scheduling_latency_s":0.994906,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013955,"completed_at":"2026-08-16T12:35:05.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 244.764588] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed3a0ed5cbb59fef3916008","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed3a0ed5cbb59fef3916008: start","job_status":"start","queue_duration_s":1.0099,"scheduling_latency_s":1.009916}1477gitlab # [ 244.776933] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed3a0ed5cbb59fef3916008","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed3a0ed5cbb59fef3916008: done: 0.013696 sec","job_status":"done","queue_duration_s":1.0099,"scheduling_latency_s":1.009916,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013696,"completed_at":"2026-08-16T12:35:05.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 244.816842] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36e5e186f7c571a1de22c8dd","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36e5e186f7c571a1de22c8dd: start","job_status":"start","queue_duration_s":1.02466,"scheduling_latency_s":1.024676}1479gitlab # [ 244.850400] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36e5e186f7c571a1de22c8dd","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36e5e186f7c571a1de22c8dd: done: 0.014169 sec","job_status":"done","queue_duration_s":1.02466,"scheduling_latency_s":1.024676,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014169,"completed_at":"2026-08-16T12:35:05.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 244.936927] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5598466314f18510b51886af","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5598466314f18510b51886af: start","job_status":"start","queue_duration_s":1.039968,"scheduling_latency_s":1.039985}1481gitlab # [ 244.964038] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5598466314f18510b51886af","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5598466314f18510b51886af: done: 0.014058 sec","job_status":"done","queue_duration_s":1.039968,"scheduling_latency_s":1.039985,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014058,"completed_at":"2026-08-16T12:35:05.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 245.015860] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf6167077dfe54a905fb679","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf6167077dfe54a905fb679: start","job_status":"start","queue_duration_s":1.055088,"scheduling_latency_s":1.055105}1483gitlab # [ 245.031010] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf6167077dfe54a905fb679","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf6167077dfe54a905fb679: done: 0.01387 sec","job_status":"done","queue_duration_s":1.055088,"scheduling_latency_s":1.055105,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01387,"completed_at":"2026-08-16T12:35:05.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 245.079111] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57edd2ef6876d65094211fbb","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57edd2ef6876d65094211fbb: start","job_status":"start","queue_duration_s":1.070061,"scheduling_latency_s":1.070078}1485gitlab # [ 245.094420] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57edd2ef6876d65094211fbb","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57edd2ef6876d65094211fbb: done: 0.014094 sec","job_status":"done","queue_duration_s":1.070061,"scheduling_latency_s":1.070078,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014094,"completed_at":"2026-08-16T12:35:05.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 245.135554] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a8965b4dee41ff6a1601da9","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a8965b4dee41ff6a1601da9: start","job_status":"start","queue_duration_s":1.085383,"scheduling_latency_s":1.0854}1487gitlab # [ 245.148127] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a8965b4dee41ff6a1601da9","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a8965b4dee41ff6a1601da9: done: 0.014283 sec","job_status":"done","queue_duration_s":1.085383,"scheduling_latency_s":1.0854,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014283,"completed_at":"2026-08-16T12:35:05.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 245.187366] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9d673ff08ccc446375494ba","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9d673ff08ccc446375494ba: start","job_status":"start","queue_duration_s":1.100739,"scheduling_latency_s":1.100755}1489gitlab # [ 245.199878] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9d673ff08ccc446375494ba","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9d673ff08ccc446375494ba: done: 0.013825 sec","job_status":"done","queue_duration_s":1.100739,"scheduling_latency_s":1.100755,"redis_calls":13,"redis_duration_s":0.001442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013825,"completed_at":"2026-08-16T12:35:05.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 245.240528] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"751b5da4b4f55ed30c1ec597","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-751b5da4b4f55ed30c1ec597: start","job_status":"start","queue_duration_s":1.115593,"scheduling_latency_s":1.115609}1491gitlab # [ 245.252946] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"751b5da4b4f55ed30c1ec597","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-751b5da4b4f55ed30c1ec597: done: 0.014035 sec","job_status":"done","queue_duration_s":1.115593,"scheduling_latency_s":1.115609,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014035,"completed_at":"2026-08-16T12:35:05.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 245.292811] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb2b52652e9f090508da3ed","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb2b52652e9f090508da3ed: start","job_status":"start","queue_duration_s":1.130673,"scheduling_latency_s":1.130689}1493gitlab # [ 245.305001] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb2b52652e9f090508da3ed","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb2b52652e9f090508da3ed: done: 0.01542 sec","job_status":"done","queue_duration_s":1.130673,"scheduling_latency_s":1.130689,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01542,"completed_at":"2026-08-16T12:35:05.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 245.344269] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9960153dba33b6db2c2fe563","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9960153dba33b6db2c2fe563: start","job_status":"start","queue_duration_s":1.147171,"scheduling_latency_s":1.147186}1495gitlab # [ 245.356652] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9960153dba33b6db2c2fe563","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9960153dba33b6db2c2fe563: done: 0.013979 sec","job_status":"done","queue_duration_s":1.147171,"scheduling_latency_s":1.147186,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013979,"completed_at":"2026-08-16T12:35:05.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 245.396151] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3b4effd3a3b026ee2e3d572","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3b4effd3a3b026ee2e3d572: start","job_status":"start","queue_duration_s":1.16224,"scheduling_latency_s":1.162257}1497gitlab # [ 245.408546] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3b4effd3a3b026ee2e3d572","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3b4effd3a3b026ee2e3d572: done: 0.013974 sec","job_status":"done","queue_duration_s":1.16224,"scheduling_latency_s":1.162257,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013974,"completed_at":"2026-08-16T12:35:05.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 245.449896] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fe730ff0b8521c011a61722","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fe730ff0b8521c011a61722: start","job_status":"start","queue_duration_s":1.17728,"scheduling_latency_s":1.177297}1499gitlab # [ 245.462579] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fe730ff0b8521c011a61722","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fe730ff0b8521c011a61722: done: 0.013779 sec","job_status":"done","queue_duration_s":1.17728,"scheduling_latency_s":1.177297,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013779,"completed_at":"2026-08-16T12:35:05.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 245.502783] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd7dea5b3b34a75b485e2e51","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd7dea5b3b34a75b485e2e51: start","job_status":"start","queue_duration_s":1.192091,"scheduling_latency_s":1.192131}1501gitlab # [ 245.515735] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd7dea5b3b34a75b485e2e51","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd7dea5b3b34a75b485e2e51: done: 0.013987 sec","job_status":"done","queue_duration_s":1.192091,"scheduling_latency_s":1.192131,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013987,"completed_at":"2026-08-16T12:35:05.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 245.555703] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52d110ab96f7a5f133e97f88","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52d110ab96f7a5f133e97f88: start","job_status":"start","queue_duration_s":1.207161,"scheduling_latency_s":1.207177}1503gitlab # [ 245.568634] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52d110ab96f7a5f133e97f88","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52d110ab96f7a5f133e97f88: done: 0.013968 sec","job_status":"done","queue_duration_s":1.207161,"scheduling_latency_s":1.207177,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013968,"completed_at":"2026-08-16T12:35:05.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 245.608612] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07d4569ec88df5ae825e19ec","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07d4569ec88df5ae825e19ec: start","job_status":"start","queue_duration_s":1.222252,"scheduling_latency_s":1.222268}1505gitlab # [ 245.621426] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07d4569ec88df5ae825e19ec","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07d4569ec88df5ae825e19ec: done: 0.013842 sec","job_status":"done","queue_duration_s":1.222252,"scheduling_latency_s":1.222268,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013842,"completed_at":"2026-08-16T12:35:05.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 245.662428] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75c4ad0c43c4f2263eef1718","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75c4ad0c43c4f2263eef1718: start","job_status":"start","queue_duration_s":1.237205,"scheduling_latency_s":1.237222}1507gitlab # [ 245.675047] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75c4ad0c43c4f2263eef1718","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75c4ad0c43c4f2263eef1718: done: 0.014441 sec","job_status":"done","queue_duration_s":1.237205,"scheduling_latency_s":1.237222,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014441,"completed_at":"2026-08-16T12:35:05.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 245.714581] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d05b6592fc187fdda81327e6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d05b6592fc187fdda81327e6: start","job_status":"start","queue_duration_s":1.252728,"scheduling_latency_s":1.252744}1509gitlab # [ 245.726905] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d05b6592fc187fdda81327e6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d05b6592fc187fdda81327e6: done: 0.013816 sec","job_status":"done","queue_duration_s":1.252728,"scheduling_latency_s":1.252744,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013816,"completed_at":"2026-08-16T12:35:05.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 245.766434] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502bb083ae611a2ccb092aa7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502bb083ae611a2ccb092aa7: start","job_status":"start","queue_duration_s":1.267576,"scheduling_latency_s":1.267592}1511gitlab # [ 245.779049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502bb083ae611a2ccb092aa7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502bb083ae611a2ccb092aa7: done: 0.013902 sec","job_status":"done","queue_duration_s":1.267576,"scheduling_latency_s":1.267592,"redis_calls":13,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013902,"completed_at":"2026-08-16T12:35:05.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 245.818853] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62786e49a28f6d499ec26d7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62786e49a28f6d499ec26d7: start","job_status":"start","queue_duration_s":1.282571,"scheduling_latency_s":1.282588}1513gitlab # [ 245.831551] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62786e49a28f6d499ec26d7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62786e49a28f6d499ec26d7: done: 0.014044 sec","job_status":"done","queue_duration_s":1.282571,"scheduling_latency_s":1.282588,"redis_calls":13,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014044,"completed_at":"2026-08-16T12:35:05.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 245.872052] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62c638abe94a6fe1fc469525","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62c638abe94a6fe1fc469525: start","job_status":"start","queue_duration_s":1.297689,"scheduling_latency_s":1.297706}1515gitlab # [ 245.884426] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62c638abe94a6fe1fc469525","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62c638abe94a6fe1fc469525: done: 0.014942 sec","job_status":"done","queue_duration_s":1.297689,"scheduling_latency_s":1.297706,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014942,"completed_at":"2026-08-16T12:35:05.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 245.923217] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42d72377841feadc1af60d98","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42d72377841feadc1af60d98: start","job_status":"start","queue_duration_s":1.313725,"scheduling_latency_s":1.313742}1517gitlab # [ 245.935674] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42d72377841feadc1af60d98","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42d72377841feadc1af60d98: done: 0.01392 sec","job_status":"done","queue_duration_s":1.313725,"scheduling_latency_s":1.313742,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01392,"completed_at":"2026-08-16T12:35:05.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 245.974877] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95e0a6367686ddb4db3f569c","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95e0a6367686ddb4db3f569c: start","job_status":"start","queue_duration_s":1.328747,"scheduling_latency_s":1.328764}1519gitlab # [ 245.987193] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95e0a6367686ddb4db3f569c","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95e0a6367686ddb4db3f569c: done: 0.01412 sec","job_status":"done","queue_duration_s":1.328747,"scheduling_latency_s":1.328764,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01412,"completed_at":"2026-08-16T12:35:05.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 246.026666] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d82d20c5dd8b3bc5e615955","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d82d20c5dd8b3bc5e615955: start","job_status":"start","queue_duration_s":1.343901,"scheduling_latency_s":1.343917}1521gitlab # [ 246.039115] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d82d20c5dd8b3bc5e615955","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d82d20c5dd8b3bc5e615955: done: 0.013804 sec","job_status":"done","queue_duration_s":1.343901,"scheduling_latency_s":1.343917,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013804,"completed_at":"2026-08-16T12:35:05.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 246.080110] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff7d0c801dd6ca1599a73a0","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff7d0c801dd6ca1599a73a0: start","job_status":"start","queue_duration_s":1.358754,"scheduling_latency_s":1.35877}1523gitlab # [ 246.092641] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff7d0c801dd6ca1599a73a0","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff7d0c801dd6ca1599a73a0: done: 0.01406 sec","job_status":"done","queue_duration_s":1.358754,"scheduling_latency_s":1.35877,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01406,"completed_at":"2026-08-16T12:35:05.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 246.132542] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a8caf2d9f078f6e1082bba","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a8caf2d9f078f6e1082bba: start","job_status":"start","queue_duration_s":1.373903,"scheduling_latency_s":1.37392}1525gitlab # [ 246.144985] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a8caf2d9f078f6e1082bba","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a8caf2d9f078f6e1082bba: done: 0.013782 sec","job_status":"done","queue_duration_s":1.373903,"scheduling_latency_s":1.37392,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013782,"completed_at":"2026-08-16T12:35:05.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 246.184242] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f3111571ec45e99da3b6e7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f3111571ec45e99da3b6e7: start","job_status":"start","queue_duration_s":1.388758,"scheduling_latency_s":1.388774}1527gitlab # [ 246.196676] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40f3111571ec45e99da3b6e7","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40f3111571ec45e99da3b6e7: done: 0.013871 sec","job_status":"done","queue_duration_s":1.388758,"scheduling_latency_s":1.388774,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013871,"completed_at":"2026-08-16T12:35:05.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 246.236324] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03cc8493d477344f834048f4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03cc8493d477344f834048f4: start","job_status":"start","queue_duration_s":1.403679,"scheduling_latency_s":1.403696}1529gitlab # [ 246.249770] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03cc8493d477344f834048f4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03cc8493d477344f834048f4: done: 0.013951 sec","job_status":"done","queue_duration_s":1.403679,"scheduling_latency_s":1.403696,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013951,"completed_at":"2026-08-16T12:35:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 246.289429] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4408d9fd49a580e0e2cae1f6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4408d9fd49a580e0e2cae1f6: start","job_status":"start","queue_duration_s":1.418694,"scheduling_latency_s":1.418711}1531gitlab # [ 246.302195] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4408d9fd49a580e0e2cae1f6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4408d9fd49a580e0e2cae1f6: done: 0.013722 sec","job_status":"done","queue_duration_s":1.418694,"scheduling_latency_s":1.418711,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013722,"completed_at":"2026-08-16T12:35:05.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 246.342343] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04d05a2def7dd241fc7d71e4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04d05a2def7dd241fc7d71e4: start","job_status":"start","queue_duration_s":1.433516,"scheduling_latency_s":1.433532}1533gitlab # [ 246.355136] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04d05a2def7dd241fc7d71e4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04d05a2def7dd241fc7d71e4: done: 0.014284 sec","job_status":"done","queue_duration_s":1.433516,"scheduling_latency_s":1.433532,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014284,"completed_at":"2026-08-16T12:35:05.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 246.395388] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41968e4684e12a407f4a86ce","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41968e4684e12a407f4a86ce: start","job_status":"start","queue_duration_s":1.448925,"scheduling_latency_s":1.448943}1535gitlab # [ 246.408062] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41968e4684e12a407f4a86ce","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41968e4684e12a407f4a86ce: done: 0.013874 sec","job_status":"done","queue_duration_s":1.448925,"scheduling_latency_s":1.448943,"redis_calls":13,"redis_duration_s":0.001393,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013874,"completed_at":"2026-08-16T12:35:05.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 246.448071] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc627f444c233e6d06063c4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc627f444c233e6d06063c4: start","job_status":"start","queue_duration_s":1.463869,"scheduling_latency_s":1.463885}1537gitlab # [ 246.461478] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc627f444c233e6d06063c4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc627f444c233e6d06063c4: done: 0.013767 sec","job_status":"done","queue_duration_s":1.463869,"scheduling_latency_s":1.463885,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013767,"completed_at":"2026-08-16T12:35:05.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 246.501238] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"772839be174bf0832f776d18","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-772839be174bf0832f776d18: start","job_status":"start","queue_duration_s":1.478774,"scheduling_latency_s":1.478792}1539gitlab # [ 246.513960] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"772839be174bf0832f776d18","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-772839be174bf0832f776d18: done: 0.014012 sec","job_status":"done","queue_duration_s":1.478774,"scheduling_latency_s":1.478792,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014012,"completed_at":"2026-08-16T12:35:05.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 246.553791] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c145d0287f7640a9dea434c6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c145d0287f7640a9dea434c6: start","job_status":"start","queue_duration_s":1.493871,"scheduling_latency_s":1.493889}1541gitlab # [ 246.566450] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c145d0287f7640a9dea434c6","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c145d0287f7640a9dea434c6: done: 0.013615 sec","job_status":"done","queue_duration_s":1.493871,"scheduling_latency_s":1.493889,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013615,"completed_at":"2026-08-16T12:35:05.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 246.606196] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27c515ea9483be8a40b8a9c2","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27c515ea9483be8a40b8a9c2: start","job_status":"start","queue_duration_s":1.508553,"scheduling_latency_s":1.50857}1543gitlab # [ 246.618991] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27c515ea9483be8a40b8a9c2","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27c515ea9483be8a40b8a9c2: done: 0.01372 sec","job_status":"done","queue_duration_s":1.508553,"scheduling_latency_s":1.50857,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01372,"completed_at":"2026-08-16T12:35:05.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 246.660136] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f3a44dc68461d2e04a2dfb3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f3a44dc68461d2e04a2dfb3: start","job_status":"start","queue_duration_s":1.523369,"scheduling_latency_s":1.523386}1545gitlab # [ 246.672870] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f3a44dc68461d2e04a2dfb3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f3a44dc68461d2e04a2dfb3: done: 0.014049 sec","job_status":"done","queue_duration_s":1.523369,"scheduling_latency_s":1.523386,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014049,"completed_at":"2026-08-16T12:35:05.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 246.713179] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc52d83802fd02b2882feae","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc52d83802fd02b2882feae: start","job_status":"start","queue_duration_s":1.538505,"scheduling_latency_s":1.538523}1547gitlab # [ 246.725616] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc52d83802fd02b2882feae","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc52d83802fd02b2882feae: done: 0.014229 sec","job_status":"done","queue_duration_s":1.538505,"scheduling_latency_s":1.538523,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014229,"completed_at":"2026-08-16T12:35:05.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 246.765497] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d6c84411329a8a13ac53a3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d6c84411329a8a13ac53a3: start","job_status":"start","queue_duration_s":1.553824,"scheduling_latency_s":1.553841}1549gitlab # [ 246.778270] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d6c84411329a8a13ac53a3","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d6c84411329a8a13ac53a3: done: 0.014146 sec","job_status":"done","queue_duration_s":1.553824,"scheduling_latency_s":1.553841,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014146,"completed_at":"2026-08-16T12:35:05.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 246.817956] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b816b687f3da88b1f279a4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b816b687f3da88b1f279a4: start","job_status":"start","queue_duration_s":1.569126,"scheduling_latency_s":1.569144}1551gitlab # [ 246.830712] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b816b687f3da88b1f279a4","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b816b687f3da88b1f279a4: done: 0.013858 sec","job_status":"done","queue_duration_s":1.569126,"scheduling_latency_s":1.569144,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013858,"completed_at":"2026-08-16T12:35:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 246.871622] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae26d1a034afc556dbe24c5","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae26d1a034afc556dbe24c5: start","job_status":"start","queue_duration_s":1.584036,"scheduling_latency_s":1.584052}1553gitlab # [ 246.884622] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:35:05.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae26d1a034afc556dbe24c5","created_at":"2026-08-16T12:35:03.945Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-1c24860ec9754b5a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f03a4a1f14e2c27df996c41b7917ce80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:35:04.021Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae26d1a034afc556dbe24c5: done: 0.013849 sec","job_status":"done","queue_duration_s":1.584036,"scheduling_latency_s":1.584052,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013849,"completed_at":"2026-08-16T12:35:05.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 273.316129] setup-gitlab-start[2974]: W, [2026-08-16T12:35:34.200115 #2974] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1555gitlab # [ 301.538430] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"940bb121d312b39c381455b4","created_at":"2026-08-16T12:36:02.307Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22f0947881e8bbc6c58a550383db9e80","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.419Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-940bb121d312b39c381455b4: start","job_status":"start","queue_duration_s":0.002867,"scheduling_latency_s":0.002912}1556gitlab # [ 301.728757] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"940bb121d312b39c381455b4","created_at":"2026-08-16T12:36:02.307Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22f0947881e8bbc6c58a550383db9e80","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.419Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-940bb121d312b39c381455b4: done: 0.190782 sec","job_status":"done","queue_duration_s":0.002867,"scheduling_latency_s":0.002912,"redis_calls":15,"redis_duration_s":0.008863,"redis_read_bytes":1029,"redis_write_bytes":1385,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003589,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":559,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.190782,"completed_at":"2026-08-16T12:36:02.612Z","load_balancing_strategy":"primary","db_duration_s":0.086351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 301.825668] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c6c7463a91055783e8180641","created_at":"2026-08-16T12:36:02.461Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8aee36e462a7ca039a2a56db7e3ea310","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.497Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c6c7463a91055783e8180641: start","job_status":"start","queue_duration_s":0.17785,"scheduling_latency_s":0.177898}1558gitlab # [ 301.913247] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c6c7463a91055783e8180641","created_at":"2026-08-16T12:36:02.461Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8aee36e462a7ca039a2a56db7e3ea310","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.497Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c6c7463a91055783e8180641: done: 0.121622 sec","job_status":"done","queue_duration_s":0.17785,"scheduling_latency_s":0.177898,"redis_calls":8,"redis_duration_s":0.043681000000000005,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001102,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.038219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.121622,"completed_at":"2026-08-16T12:36:02.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 302.001484] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"8b6bf0b77b29f389fceea6fd","created_at":"2026-08-16T12:36:02.520Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ba1f0aee5826b197e66e8277dc3f3169","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.534Z","job_size_bytes":3,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-8b6bf0b77b29f389fceea6fd: start","job_status":"start","queue_duration_s":0.308301,"scheduling_latency_s":0.308348}1560gitlab # [ 302.113009] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:02.995Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"8b6bf0b77b29f389fceea6fd","created_at":"2026-08-16T12:36:02.520Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ba1f0aee5826b197e66e8277dc3f3169","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.534Z","job_size_bytes":3,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-8b6bf0b77b29f389fceea6fd: done: 0.152983 sec","job_status":"done","queue_duration_s":0.308301,"scheduling_latency_s":0.308348,"redis_calls":11,"redis_duration_s":0.049867999999999996,"redis_read_bytes":13,"redis_write_bytes":1207,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.007579,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.039721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03174416,"duration_s":0.152983,"completed_at":"2026-08-16T12:36:02.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 302.197643] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"10ee3c7bd42717cae492473c","created_at":"2026-08-16T12:36:02.552Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d7421a4fd4d24d53fc675130d99dace","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.559Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-10ee3c7bd42717cae492473c: start","job_status":"start","queue_duration_s":0.457724,"scheduling_latency_s":0.457773}1562gitlab # [ 302.311353] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"10ee3c7bd42717cae492473c","created_at":"2026-08-16T12:36:02.552Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d7421a4fd4d24d53fc675130d99dace","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.559Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-10ee3c7bd42717cae492473c: done: 0.178077 sec","job_status":"done","queue_duration_s":0.457724,"scheduling_latency_s":0.457773,"redis_calls":11,"redis_duration_s":0.012781,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00761,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.178077,"completed_at":"2026-08-16T12:36:03.195Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 302.403769] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8823b346abe76cfb7b1b3be1","created_at":"2026-08-16T12:36:02.590Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7a95089de7cdb961ed677273061cd55","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.604Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8823b346abe76cfb7b1b3be1: start","job_status":"start","queue_duration_s":0.595168,"scheduling_latency_s":0.595219}1564gitlab # [ 302.441706] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8823b346abe76cfb7b1b3be1","created_at":"2026-08-16T12:36:02.590Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7a95089de7cdb961ed677273061cd55","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.604Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8823b346abe76cfb7b1b3be1: done: 0.124648 sec","job_status":"done","queue_duration_s":0.595168,"scheduling_latency_s":0.595219,"redis_calls":10,"redis_duration_s":0.008371,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000354,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00134866,"exclusive_lock_hold_duration_s":0.01018104,"duration_s":0.124648,"completed_at":"2026-08-16T12:36:03.324Z","load_balancing_strategy":"primary","db_duration_s":0.004726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 302.522567] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5f26f07ecae55b2e39e45131","created_at":"2026-08-16T12:36:02.677Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6416a60d3a647f44a868f8a2e9b28071","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.688Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5f26f07ecae55b2e39e45131: start","job_status":"start","queue_duration_s":0.640707,"scheduling_latency_s":0.640757}1566gitlab # [ 302.540434] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.371Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1567gitlab # [ 302.584948] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.468Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5f26f07ecae55b2e39e45131","created_at":"2026-08-16T12:36:02.677Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6416a60d3a647f44a868f8a2e9b28071","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.688Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5f26f07ecae55b2e39e45131: done: 0.13924 sec","job_status":"done","queue_duration_s":0.640707,"scheduling_latency_s":0.640757,"redis_calls":8,"redis_duration_s":0.006915,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000877,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13924,"completed_at":"2026-08-16T12:36:03.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 302.686054] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6f852493bba3000c2d6fdc83","created_at":"2026-08-16T12:36:02.721Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"358e455299be690c00fb7f0540bf5c67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.733Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6f852493bba3000c2d6fdc83: start","job_status":"start","queue_duration_s":0.765792,"scheduling_latency_s":0.765848}1569gitlab # [ 302.826339] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.710Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1570gitlab # [ 302.881095] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6f852493bba3000c2d6fdc83","created_at":"2026-08-16T12:36:02.721Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"358e455299be690c00fb7f0540bf5c67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.733Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6f852493bba3000c2d6fdc83: done: 0.260204 sec","job_status":"done","queue_duration_s":0.765792,"scheduling_latency_s":0.765848,"redis_calls":8,"redis_duration_s":0.033733,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001641,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.260204,"completed_at":"2026-08-16T12:36:03.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 302.967110] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"7803b96bbdb21361a7491c93","created_at":"2026-08-16T12:36:02.757Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7705b668820b5725682ff2fb73d0bda0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.769Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-7803b96bbdb21361a7491c93: start","job_status":"start","queue_duration_s":1.013542,"scheduling_latency_s":1.013597}1572gitlab # [ 303.004931] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"7803b96bbdb21361a7491c93","created_at":"2026-08-16T12:36:02.757Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7705b668820b5725682ff2fb73d0bda0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.769Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-7803b96bbdb21361a7491c93: done: 0.105175 sec","job_status":"done","queue_duration_s":1.013542,"scheduling_latency_s":1.013597,"redis_calls":10,"redis_duration_s":0.008218,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000433,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003497,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00293366,"exclusive_lock_hold_duration_s":0.01214846,"duration_s":0.105175,"completed_at":"2026-08-16T12:36:03.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 303.089378] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"67e59fe590ba9d6446824b99","created_at":"2026-08-16T12:36:02.791Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3edfe87ac7f1cd21812aa18fa3bdc614","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.802Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-67e59fe590ba9d6446824b99: start","job_status":"start","queue_duration_s":1.091255,"scheduling_latency_s":1.09129}1574gitlab # [ 303.107263] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"67e59fe590ba9d6446824b99","created_at":"2026-08-16T12:36:02.791Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3edfe87ac7f1cd21812aa18fa3bdc614","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.802Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-67e59fe590ba9d6446824b99: done: 0.045679 sec","job_status":"done","queue_duration_s":1.091255,"scheduling_latency_s":1.09129,"redis_calls":10,"redis_duration_s":0.004293,"redis_read_bytes":389,"redis_write_bytes":1014,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001271,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":238,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045679,"completed_at":"2026-08-16T12:36:03.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 303.151967] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4a3f34280fdaddea8619dfe9","created_at":"2026-08-16T12:36:02.821Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da672151eb6408595b37fadd03085535","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:36:02.829Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4a3f34280fdaddea8619dfe9: start","job_status":"start","queue_duration_s":1.112568,"scheduling_latency_s":1.112593}1576gitlab # [ 303.165669] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.960Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1577gitlab # [ 303.169023] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4a3f34280fdaddea8619dfe9","created_at":"2026-08-16T12:36:02.821Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da672151eb6408595b37fadd03085535","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T12:36:02.829Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4a3f34280fdaddea8619dfe9: done: 0.02994 sec","job_status":"done","queue_duration_s":1.112568,"scheduling_latency_s":1.112593,"redis_calls":8,"redis_duration_s":0.0028350000000000003,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02994,"completed_at":"2026-08-16T12:36:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 303.211156] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:03.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7adf76c7406e120e8e549da2","created_at":"2026-08-16T12:36:02.841Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced21cf8923c2f909b4f5896f730220b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:36:02.850Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7adf76c7406e120e8e549da2: start","job_status":"start","queue_duration_s":1.124117,"scheduling_latency_s":1.12414}1579gitlab # [ 303.224871] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7adf76c7406e120e8e549da2","created_at":"2026-08-16T12:36:02.841Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced21cf8923c2f909b4f5896f730220b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T12:36:02.850Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7adf76c7406e120e8e549da2: done: 0.052632 sec","job_status":"done","queue_duration_s":1.124117,"scheduling_latency_s":1.12414,"redis_calls":8,"redis_duration_s":0.004115,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052632,"completed_at":"2026-08-16T12:36:04.027Z","load_balancing_strategy":"primary","db_duration_s":0.007103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 303.267423] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0e9e3283d9c284e1b65f127e","created_at":"2026-08-16T12:36:02.857Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c6a374df8dd9dbdbc23ef4b6ce19fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.864Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0e9e3283d9c284e1b65f127e: start","job_status":"start","queue_duration_s":1.165367,"scheduling_latency_s":1.165393}1581gitlab # [ 303.282206] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.049Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1582gitlab # [ 303.285894] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.059Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0e9e3283d9c284e1b65f127e","created_at":"2026-08-16T12:36:02.857Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c6a374df8dd9dbdbc23ef4b6ce19fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.864Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0e9e3283d9c284e1b65f127e: done: 0.029192 sec","job_status":"done","queue_duration_s":1.165367,"scheduling_latency_s":1.165393,"redis_calls":8,"redis_duration_s":0.003193,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002035,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029192,"completed_at":"2026-08-16T12:36:04.059Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 303.329097] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"006b446c82b8eb938c22497c","created_at":"2026-08-16T12:36:02.876Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.881Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-006b446c82b8eb938c22497c: start","job_status":"start","queue_duration_s":1.180801,"scheduling_latency_s":1.180825}1584gitlab # [ 303.342714] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"006b446c82b8eb938c22497c","created_at":"2026-08-16T12:36:02.876Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.881Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-006b446c82b8eb938c22497c: done: 0.054617 sec","job_status":"done","queue_duration_s":1.180801,"scheduling_latency_s":1.180825,"redis_calls":16,"redis_duration_s":0.006921,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000833,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000461,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003259,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002368,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054617,"completed_at":"2026-08-16T12:36:04.116Z","load_balancing_strategy":"primary","db_duration_s":0.004298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 303.386215] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"94cbdfbecb8299dfc38a6660","created_at":"2026-08-16T12:36:02.904Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdd14aadf2c50b9ff3c69ce9c1814846","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.919Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-94cbdfbecb8299dfc38a6660: start","job_status":"start","queue_duration_s":1.200298,"scheduling_latency_s":1.20032}1586gitlab # [ 303.968174] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"94cbdfbecb8299dfc38a6660","created_at":"2026-08-16T12:36:02.904Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdd14aadf2c50b9ff3c69ce9c1814846","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:02.919Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-94cbdfbecb8299dfc38a6660: done: 0.731603 sec","job_status":"done","queue_duration_s":1.200298,"scheduling_latency_s":1.20032,"redis_calls":563,"redis_duration_s":0.200041,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.1983,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.608456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.731603,"completed_at":"2026-08-16T12:36:04.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 304.064731] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e5d6eeb9cb78288a47717493","created_at":"2026-08-16T12:36:02.963Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d701e6903814370fbf088cadada4ae1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:36:02.984Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e5d6eeb9cb78288a47717493: start","job_status":"start","queue_duration_s":1.869374,"scheduling_latency_s":1.869466}1588gitlab # [ 304.084202] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.863Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1589gitlab # [ 304.089148] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"e5d6eeb9cb78288a47717493","created_at":"2026-08-16T12:36:02.963Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d701e6903814370fbf088cadada4ae1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T12:36:02.984Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-e5d6eeb9cb78288a47717493: done: 0.016114 sec","job_status":"done","queue_duration_s":1.869374,"scheduling_latency_s":1.869466,"redis_calls":8,"redis_duration_s":0.002204,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016114,"completed_at":"2026-08-16T12:36:04.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 304.147570] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:04.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"329b4d09c06556a651e19abd","created_at":"2026-08-16T12:36:03.019Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2168dc73b3fafe360838c86e6e3e6809","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.030Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-329b4d09c06556a651e19abd: start","job_status":"start","queue_duration_s":1.841047,"scheduling_latency_s":1.84107}1591gitlab # [ 304.163590] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"329b4d09c06556a651e19abd","created_at":"2026-08-16T12:36:03.019Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2168dc73b3fafe360838c86e6e3e6809","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.030Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-329b4d09c06556a651e19abd: done: 0.158553 sec","job_status":"done","queue_duration_s":1.841047,"scheduling_latency_s":1.84107,"redis_calls":11,"redis_duration_s":0.003437,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060328,"exclusive_lock_hold_duration_s":0.13387298,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.158553,"completed_at":"2026-08-16T12:36:05.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.115078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 304.210055] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"dfb2b07d6664988b3541a1fd","created_at":"2026-08-16T12:36:03.073Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d240e158c94536438e2e4a2ffc148396","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.084Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-dfb2b07d6664988b3541a1fd: start","job_status":"start","queue_duration_s":1.948978,"scheduling_latency_s":1.949021}1593gitlab # [ 304.225054] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"dfb2b07d6664988b3541a1fd","created_at":"2026-08-16T12:36:03.073Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d240e158c94536438e2e4a2ffc148396","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.084Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-dfb2b07d6664988b3541a1fd: done: 0.040375 sec","job_status":"done","queue_duration_s":1.948978,"scheduling_latency_s":1.949021,"redis_calls":8,"redis_duration_s":0.002898,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040375,"completed_at":"2026-08-16T12:36:05.073Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 304.269534] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"66420e2001301c4de520750f","created_at":"2026-08-16T12:36:03.112Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7cb6db6e90c7a75605e91ea82c89aaf","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.133Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-66420e2001301c4de520750f: start","job_status":"start","queue_duration_s":1.945231,"scheduling_latency_s":1.945278}1595gitlab # [ 304.284240] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"66420e2001301c4de520750f","created_at":"2026-08-16T12:36:03.112Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7cb6db6e90c7a75605e91ea82c89aaf","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.133Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-66420e2001301c4de520750f: done: 0.081604 sec","job_status":"done","queue_duration_s":1.945231,"scheduling_latency_s":1.945278,"redis_calls":10,"redis_duration_s":0.003946,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006515,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.081604,"completed_at":"2026-08-16T12:36:05.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 304.329900] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0d4371f4d873fc1728e5aeaf","created_at":"2026-08-16T12:36:03.176Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.189Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0d4371f4d873fc1728e5aeaf: start","job_status":"start","queue_duration_s":1.974384,"scheduling_latency_s":1.974422}1597gitlab # [ 304.424807] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0d4371f4d873fc1728e5aeaf","created_at":"2026-08-16T12:36:03.176Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.189Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0d4371f4d873fc1728e5aeaf: done: 0.146031 sec","job_status":"done","queue_duration_s":1.974384,"scheduling_latency_s":1.974422,"redis_calls":65,"redis_duration_s":0.017494,"redis_read_bytes":748,"redis_write_bytes":41402,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001009,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000857,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014793,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.146031,"completed_at":"2026-08-16T12:36:05.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 304.510248] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2d0c32523e813024b2b7048d","created_at":"2026-08-16T12:36:03.215Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbaef8876b87d6c89b6b4b8dcaffd79","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.222Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2d0c32523e813024b2b7048d: start","job_status":"start","queue_duration_s":2.089209,"scheduling_latency_s":2.089232}1599gitlab # [ 304.530079] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2d0c32523e813024b2b7048d","created_at":"2026-08-16T12:36:03.215Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbaef8876b87d6c89b6b4b8dcaffd79","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.222Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2d0c32523e813024b2b7048d: done: 0.01814 sec","job_status":"done","queue_duration_s":2.089209,"scheduling_latency_s":2.089232,"redis_calls":8,"redis_duration_s":0.0020859999999999997,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01814,"completed_at":"2026-08-16T12:36:05.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 304.576252] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"092d20a34b50675bbdea5433","created_at":"2026-08-16T12:36:03.229Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f15c2ff30fbf29c806ce4c595209d6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.237Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-092d20a34b50675bbdea5433: start","job_status":"start","queue_duration_s":2.093551,"scheduling_latency_s":2.093569}1601gitlab # [ 304.590766] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"092d20a34b50675bbdea5433","created_at":"2026-08-16T12:36:03.229Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f15c2ff30fbf29c806ce4c595209d6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.237Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-092d20a34b50675bbdea5433: done: 0.020689 sec","job_status":"done","queue_duration_s":2.093551,"scheduling_latency_s":2.093569,"redis_calls":10,"redis_duration_s":0.0028450000000000003,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062696,"exclusive_lock_hold_duration_s":0.00431844,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.020689,"completed_at":"2026-08-16T12:36:05.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 304.635058] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"030d160cdc1ac83832c5f2e1","created_at":"2026-08-16T12:36:03.307Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1704960f9339cc2196f00c8e238e9c1d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.336Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-030d160cdc1ac83832c5f2e1: start","job_status":"start","queue_duration_s":2.017741,"scheduling_latency_s":2.017795}1603gitlab # [ 304.649922] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"030d160cdc1ac83832c5f2e1","created_at":"2026-08-16T12:36:03.307Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1704960f9339cc2196f00c8e238e9c1d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.336Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-030d160cdc1ac83832c5f2e1: done: 0.021673 sec","job_status":"done","queue_duration_s":2.017741,"scheduling_latency_s":2.017795,"redis_calls":12,"redis_duration_s":0.0030529999999999997,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035204,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.021673,"completed_at":"2026-08-16T12:36:05.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 304.697038] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1e5079d35c8bd74067439c05","created_at":"2026-08-16T12:36:03.436Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de0ed24a1a04d9c601881f4800486a9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.456Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1e5079d35c8bd74067439c05: start","job_status":"start","queue_duration_s":1.920835,"scheduling_latency_s":1.920851}1605gitlab # [ 304.712053] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1e5079d35c8bd74067439c05","created_at":"2026-08-16T12:36:03.436Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de0ed24a1a04d9c601881f4800486a9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.456Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1e5079d35c8bd74067439c05: done: 0.059032 sec","job_status":"done","queue_duration_s":1.920835,"scheduling_latency_s":1.920851,"redis_calls":10,"redis_duration_s":0.003019,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000217,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00077374,"exclusive_lock_hold_duration_s":0.02544826,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.059032,"completed_at":"2026-08-16T12:36:05.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 304.757929] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f02bcaed57d9437a3b45906c","created_at":"2026-08-16T12:36:03.502Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67ae02cd6844d97bd47bb33cd85d9d84","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.520Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f02bcaed57d9437a3b45906c: start","job_status":"start","queue_duration_s":1.917242,"scheduling_latency_s":1.917263}1607gitlab # [ 304.837953] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f02bcaed57d9437a3b45906c","created_at":"2026-08-16T12:36:03.502Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67ae02cd6844d97bd47bb33cd85d9d84","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.520Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f02bcaed57d9437a3b45906c: done: 0.284562 sec","job_status":"done","queue_duration_s":1.917242,"scheduling_latency_s":1.917263,"redis_calls":11,"redis_duration_s":0.003029,"redis_read_bytes":263,"redis_write_bytes":1140,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":153,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.208261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067906,"exclusive_lock_hold_duration_s":0.26587492,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.284562,"completed_at":"2026-08-16T12:36:05.722Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 304.942801] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd7afc07ad1b726c26919ca7","created_at":"2026-08-16T12:36:03.541Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a565640143c1ffc2014b672441d6551","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.552Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd7afc07ad1b726c26919ca7: start","job_status":"start","queue_duration_s":2.171859,"scheduling_latency_s":2.171877}1609gitlab # [ 304.965533] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.732Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1610gitlab # [ 304.970232] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd7afc07ad1b726c26919ca7","created_at":"2026-08-16T12:36:03.541Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a565640143c1ffc2014b672441d6551","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.552Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd7afc07ad1b726c26919ca7: done: 0.013574 sec","job_status":"done","queue_duration_s":2.171859,"scheduling_latency_s":2.171877,"redis_calls":8,"redis_duration_s":0.001374,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000154,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013574,"completed_at":"2026-08-16T12:36:05.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 305.016618] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e9aa211e4dcda29b961f5eac","created_at":"2026-08-16T12:36:03.601Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f1cf4a4cb5e359af34d45d1f750ebc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.611Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e9aa211e4dcda29b961f5eac: start","job_status":"start","queue_duration_s":2.127521,"scheduling_latency_s":2.12754}1612gitlab # [ 305.031224] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e9aa211e4dcda29b961f5eac","created_at":"2026-08-16T12:36:03.601Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f1cf4a4cb5e359af34d45d1f750ebc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.611Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e9aa211e4dcda29b961f5eac: done: 0.022003 sec","job_status":"done","queue_duration_s":2.127521,"scheduling_latency_s":2.12754,"redis_calls":11,"redis_duration_s":0.002562,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000194,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0052125,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022003,"completed_at":"2026-08-16T12:36:05.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002819,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1613gitlab # [ 305.075835] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"33ea254e26a5a54143de813e","created_at":"2026-08-16T12:36:03.631Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5747f80dd9a831c99fc5308b1493679","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.640Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-33ea254e26a5a54143de813e: start","job_status":"start","queue_duration_s":2.121674,"scheduling_latency_s":2.121689}1614gitlab # [ 305.089348] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.776Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"33ea254e26a5a54143de813e","created_at":"2026-08-16T12:36:03.631Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5747f80dd9a831c99fc5308b1493679","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.640Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-33ea254e26a5a54143de813e: done: 0.014178 sec","job_status":"done","queue_duration_s":2.121674,"scheduling_latency_s":2.121689,"redis_calls":11,"redis_duration_s":0.002385,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000607,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000211,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014178,"completed_at":"2026-08-16T12:36:05.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 305.132853] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"3d966876c45720476c423935","created_at":"2026-08-16T12:36:03.707Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5aa61f3c707d7526111d3c93f3551c7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.744Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-3d966876c45720476c423935: start","job_status":"start","queue_duration_s":2.034106,"scheduling_latency_s":2.034122}1616gitlab # [ 305.146574] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"3d966876c45720476c423935","created_at":"2026-08-16T12:36:03.707Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-bef630024ed54d04","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5aa61f3c707d7526111d3c93f3551c7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:03.744Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-3d966876c45720476c423935: done: 0.035406 sec","job_status":"done","queue_duration_s":2.034106,"scheduling_latency_s":2.034122,"redis_calls":20,"redis_duration_s":0.005316,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002075,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000331,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039352,"duration_s":0.035406,"completed_at":"2026-08-16T12:36:05.813Z","load_balancing_strategy":"primary","db_duration_s":0.002165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 305.189908] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.815Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57711f2a5034661b8fb23058","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57711f2a5034661b8fb23058: start","job_status":"start","queue_duration_s":1.707834,"scheduling_latency_s":1.707849}1618gitlab # [ 305.202398] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.827Z","message":"No existing merge request to be cleaned up."}1619gitlab # [ 305.203960] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.836Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57711f2a5034661b8fb23058","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57711f2a5034661b8fb23058: done: 0.021527 sec","job_status":"done","queue_duration_s":1.707834,"scheduling_latency_s":1.707849,"redis_calls":11,"redis_duration_s":0.002941,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001563,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021527,"completed_at":"2026-08-16T12:36:05.836Z","load_balancing_strategy":"primary","db_duration_s":0.002941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 305.244723] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.838Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6e684e325f00d9ff4d652158","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6e684e325f00d9ff4d652158: start","job_status":"start","queue_duration_s":1.730766,"scheduling_latency_s":1.731046}1621gitlab # [ 305.257024] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.849Z","message":"No existing merge request to be cleaned up."}1622gitlab # [ 305.258633] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.857Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6e684e325f00d9ff4d652158","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6e684e325f00d9ff4d652158: done: 0.019918 sec","job_status":"done","queue_duration_s":1.730766,"scheduling_latency_s":1.731046,"redis_calls":10,"redis_duration_s":0.002618,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019918,"completed_at":"2026-08-16T12:36:05.857Z","load_balancing_strategy":"primary","db_duration_s":0.00241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 305.297377] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.859Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34a2cfeaef73ae4914b10434","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34a2cfeaef73ae4914b10434: start","job_status":"start","queue_duration_s":1.752119,"scheduling_latency_s":1.752134}1624gitlab # [ 305.309556] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.870Z","message":"No existing merge request to be cleaned up."}1625gitlab # [ 305.311206] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.878Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34a2cfeaef73ae4914b10434","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34a2cfeaef73ae4914b10434: done: 0.019629 sec","job_status":"done","queue_duration_s":1.752119,"scheduling_latency_s":1.752134,"redis_calls":10,"redis_duration_s":0.002593,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001532,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019629,"completed_at":"2026-08-16T12:36:05.878Z","load_balancing_strategy":"primary","db_duration_s":0.002425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 305.351060] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.880Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34ccbf706d2100dd57d2c289","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34ccbf706d2100dd57d2c289: start","job_status":"start","queue_duration_s":1.773113,"scheduling_latency_s":1.773129}1627gitlab # [ 305.363676] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.891Z","message":"No existing merge request to be cleaned up."}1628gitlab # [ 305.365483] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.900Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34ccbf706d2100dd57d2c289","created_at":"2026-08-16T12:36:04.086Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-8d22581354f246d1","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b835de5d7c1d58024d8816b0ab0d7880","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:04.107Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34ccbf706d2100dd57d2c289: done: 0.020014 sec","job_status":"done","queue_duration_s":1.773113,"scheduling_latency_s":1.773129,"redis_calls":10,"redis_duration_s":0.002606,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001477,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020014,"completed_at":"2026-08-16T12:36:05.900Z","load_balancing_strategy":"primary","db_duration_s":0.002637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 305.404094] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899521afbcf210a4a67910fc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899521afbcf210a4a67910fc: start","job_status":"start","queue_duration_s":0.602973,"scheduling_latency_s":0.602989}1630gitlab # [ 305.416513] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899521afbcf210a4a67910fc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899521afbcf210a4a67910fc: done: 0.017077 sec","job_status":"done","queue_duration_s":0.602973,"scheduling_latency_s":0.602989,"redis_calls":14,"redis_duration_s":0.003672,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017077,"completed_at":"2026-08-16T12:36:05.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 305.457533] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb961dc2e71c90a578e7708c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb961dc2e71c90a578e7708c: start","job_status":"start","queue_duration_s":0.621383,"scheduling_latency_s":0.621398}1632gitlab # [ 305.469782] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb961dc2e71c90a578e7708c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb961dc2e71c90a578e7708c: done: 0.014756 sec","job_status":"done","queue_duration_s":0.621383,"scheduling_latency_s":0.621398,"redis_calls":13,"redis_duration_s":0.002575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001662,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014756,"completed_at":"2026-08-16T12:36:05.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 305.509021] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768d9f34f4ccf7607bd92626","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768d9f34f4ccf7607bd92626: start","job_status":"start","queue_duration_s":0.637482,"scheduling_latency_s":0.637497}1634gitlab # [ 305.522401] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768d9f34f4ccf7607bd92626","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768d9f34f4ccf7607bd92626: done: 0.01523 sec","job_status":"done","queue_duration_s":0.637482,"scheduling_latency_s":0.637497,"redis_calls":13,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01523,"completed_at":"2026-08-16T12:36:05.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 305.562100] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43c32742b7d3e055897157c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43c32742b7d3e055897157c: start","job_status":"start","queue_duration_s":0.654378,"scheduling_latency_s":0.654393}1636gitlab # [ 305.574512] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43c32742b7d3e055897157c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43c32742b7d3e055897157c: done: 0.014941 sec","job_status":"done","queue_duration_s":0.654378,"scheduling_latency_s":0.654393,"redis_calls":13,"redis_duration_s":0.002685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-16T12:36:05.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 305.614816] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c17e962d5cece984b8a639b","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c17e962d5cece984b8a639b: start","job_status":"start","queue_duration_s":0.670547,"scheduling_latency_s":0.670563}1638gitlab # [ 305.627632] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c17e962d5cece984b8a639b","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c17e962d5cece984b8a639b: done: 0.014778 sec","job_status":"done","queue_duration_s":0.670547,"scheduling_latency_s":0.670563,"redis_calls":13,"redis_duration_s":0.0025470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014778,"completed_at":"2026-08-16T12:36:05.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 305.668361] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:05.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c407e34b186f5e9142ed1308","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c407e34b186f5e9142ed1308: start","job_status":"start","queue_duration_s":0.68656,"scheduling_latency_s":0.686574}1640gitlab # [ 305.680910] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c407e34b186f5e9142ed1308","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c407e34b186f5e9142ed1308: done: 0.015779 sec","job_status":"done","queue_duration_s":0.68656,"scheduling_latency_s":0.686574,"redis_calls":13,"redis_duration_s":0.003268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015779,"completed_at":"2026-08-16T12:36:06.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 305.720376] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08299e065b264b18f47b8de6","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08299e065b264b18f47b8de6: start","job_status":"start","queue_duration_s":0.703973,"scheduling_latency_s":0.703988}1642gitlab # [ 305.734012] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08299e065b264b18f47b8de6","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08299e065b264b18f47b8de6: done: 0.014866 sec","job_status":"done","queue_duration_s":0.703973,"scheduling_latency_s":0.703988,"redis_calls":13,"redis_duration_s":0.0025830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014866,"completed_at":"2026-08-16T12:36:06.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 305.773945] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b379bafc6676df3e90b9b7","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b379bafc6676df3e90b9b7: start","job_status":"start","queue_duration_s":0.720195,"scheduling_latency_s":0.720209}1644gitlab # [ 305.786984] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b379bafc6676df3e90b9b7","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b379bafc6676df3e90b9b7: done: 0.015133 sec","job_status":"done","queue_duration_s":0.720195,"scheduling_latency_s":0.720209,"redis_calls":13,"redis_duration_s":0.0027029999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015133,"completed_at":"2026-08-16T12:36:06.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 305.826564] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8497d5a5b202381c44af5d91","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8497d5a5b202381c44af5d91: start","job_status":"start","queue_duration_s":0.736701,"scheduling_latency_s":0.736716}1646gitlab # [ 305.839248] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8497d5a5b202381c44af5d91","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8497d5a5b202381c44af5d91: done: 0.015502 sec","job_status":"done","queue_duration_s":0.736701,"scheduling_latency_s":0.736716,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015502,"completed_at":"2026-08-16T12:36:06.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 305.878498] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"655dda9b8357ee5f543432ce","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-655dda9b8357ee5f543432ce: start","job_status":"start","queue_duration_s":0.761083,"scheduling_latency_s":0.761099}1648gitlab # [ 305.891018] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"655dda9b8357ee5f543432ce","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-655dda9b8357ee5f543432ce: done: 0.0151 sec","job_status":"done","queue_duration_s":0.761083,"scheduling_latency_s":0.761099,"redis_calls":13,"redis_duration_s":0.003043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0151,"completed_at":"2026-08-16T12:36:06.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 305.931490] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7541c93b61bb824326ca1553","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7541c93b61bb824326ca1553: start","job_status":"start","queue_duration_s":0.777608,"scheduling_latency_s":0.777624}1650gitlab # [ 305.944328] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7541c93b61bb824326ca1553","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7541c93b61bb824326ca1553: done: 0.014742 sec","job_status":"done","queue_duration_s":0.777608,"scheduling_latency_s":0.777624,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014742,"completed_at":"2026-08-16T12:36:06.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 305.984001] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff64a53edc04756a96177bd4","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff64a53edc04756a96177bd4: start","job_status":"start","queue_duration_s":0.793692,"scheduling_latency_s":0.793707}1652gitlab # [ 305.996245] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff64a53edc04756a96177bd4","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff64a53edc04756a96177bd4: done: 0.01445 sec","job_status":"done","queue_duration_s":0.793692,"scheduling_latency_s":0.793707,"redis_calls":13,"redis_duration_s":0.002648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01445,"completed_at":"2026-08-16T12:36:06.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 306.035428] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1666f4163b20bdb78593d217","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1666f4163b20bdb78593d217: start","job_status":"start","queue_duration_s":0.809466,"scheduling_latency_s":0.809481}1654gitlab # [ 306.048101] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1666f4163b20bdb78593d217","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1666f4163b20bdb78593d217: done: 0.014692 sec","job_status":"done","queue_duration_s":0.809466,"scheduling_latency_s":0.809481,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014692,"completed_at":"2026-08-16T12:36:06.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 306.087173] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9779c322fffe53a08cbe428c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9779c322fffe53a08cbe428c: start","job_status":"start","queue_duration_s":0.825486,"scheduling_latency_s":0.825502}1656gitlab # [ 306.099707] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9779c322fffe53a08cbe428c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9779c322fffe53a08cbe428c: done: 0.014419 sec","job_status":"done","queue_duration_s":0.825486,"scheduling_latency_s":0.825502,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014419,"completed_at":"2026-08-16T12:36:06.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 306.140044] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b096cf4fb51f9fc1f09bbebf","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b096cf4fb51f9fc1f09bbebf: start","job_status":"start","queue_duration_s":0.84121,"scheduling_latency_s":0.841225}1658gitlab # [ 306.152342] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b096cf4fb51f9fc1f09bbebf","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b096cf4fb51f9fc1f09bbebf: done: 0.014537 sec","job_status":"done","queue_duration_s":0.84121,"scheduling_latency_s":0.841225,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014537,"completed_at":"2026-08-16T12:36:06.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 306.191738] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2be7269d5f8f9943989bab7c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2be7269d5f8f9943989bab7c: start","job_status":"start","queue_duration_s":0.857122,"scheduling_latency_s":0.857137}1660gitlab # [ 306.204509] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2be7269d5f8f9943989bab7c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2be7269d5f8f9943989bab7c: done: 0.014454 sec","job_status":"done","queue_duration_s":0.857122,"scheduling_latency_s":0.857137,"redis_calls":13,"redis_duration_s":0.002544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014454,"completed_at":"2026-08-16T12:36:06.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 306.243599] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecb176869f1fdec47d75d04","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecb176869f1fdec47d75d04: start","job_status":"start","queue_duration_s":0.872885,"scheduling_latency_s":0.872899}1662gitlab # [ 306.256253] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecb176869f1fdec47d75d04","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecb176869f1fdec47d75d04: done: 0.014359 sec","job_status":"done","queue_duration_s":0.872885,"scheduling_latency_s":0.872899,"redis_calls":13,"redis_duration_s":0.002622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014359,"completed_at":"2026-08-16T12:36:06.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 306.295105] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d80b8aa3a2df378da9e8bf63","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d80b8aa3a2df378da9e8bf63: start","job_status":"start","queue_duration_s":0.888552,"scheduling_latency_s":0.888567}1664gitlab # [ 306.307759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d80b8aa3a2df378da9e8bf63","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d80b8aa3a2df378da9e8bf63: done: 0.014665 sec","job_status":"done","queue_duration_s":0.888552,"scheduling_latency_s":0.888567,"redis_calls":13,"redis_duration_s":0.002701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014665,"completed_at":"2026-08-16T12:36:06.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 306.348164] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe04968a5be8486f411964a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe04968a5be8486f411964a: start","job_status":"start","queue_duration_s":0.904566,"scheduling_latency_s":0.904581}1666gitlab # [ 306.360439] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe04968a5be8486f411964a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe04968a5be8486f411964a: done: 0.014755 sec","job_status":"done","queue_duration_s":0.904566,"scheduling_latency_s":0.904581,"redis_calls":13,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014755,"completed_at":"2026-08-16T12:36:06.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 306.399736] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c59a2d049388281e0414ae","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c59a2d049388281e0414ae: start","job_status":"start","queue_duration_s":0.92068,"scheduling_latency_s":0.920694}1668gitlab # [ 306.412455] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c59a2d049388281e0414ae","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c59a2d049388281e0414ae: done: 0.014574 sec","job_status":"done","queue_duration_s":0.92068,"scheduling_latency_s":0.920694,"redis_calls":13,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014574,"completed_at":"2026-08-16T12:36:06.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 306.451644] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"210bc36e0e81b9ec859ebe6e","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-210bc36e0e81b9ec859ebe6e: start","job_status":"start","queue_duration_s":0.93661,"scheduling_latency_s":0.936625}1670gitlab # [ 306.464296] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"210bc36e0e81b9ec859ebe6e","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-210bc36e0e81b9ec859ebe6e: done: 0.014724 sec","job_status":"done","queue_duration_s":0.93661,"scheduling_latency_s":0.936625,"redis_calls":13,"redis_duration_s":0.002722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014724,"completed_at":"2026-08-16T12:36:06.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 306.503413] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94825dfbc0940d19cb480e48","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94825dfbc0940d19cb480e48: start","job_status":"start","queue_duration_s":0.952693,"scheduling_latency_s":0.952707}1672gitlab # [ 306.516045] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94825dfbc0940d19cb480e48","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94825dfbc0940d19cb480e48: done: 0.014561 sec","job_status":"done","queue_duration_s":0.952693,"scheduling_latency_s":0.952707,"redis_calls":13,"redis_duration_s":0.00264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014561,"completed_at":"2026-08-16T12:36:06.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 306.556228] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4de2021eb36e4557b1ad16ac","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4de2021eb36e4557b1ad16ac: start","job_status":"start","queue_duration_s":0.968564,"scheduling_latency_s":0.96858}1674gitlab # [ 306.569093] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4de2021eb36e4557b1ad16ac","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4de2021eb36e4557b1ad16ac: done: 0.014804 sec","job_status":"done","queue_duration_s":0.968564,"scheduling_latency_s":0.96858,"redis_calls":13,"redis_duration_s":0.0027919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014804,"completed_at":"2026-08-16T12:36:06.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 306.608810] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ece8663e775fc75a19587c5a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ece8663e775fc75a19587c5a: start","job_status":"start","queue_duration_s":0.984696,"scheduling_latency_s":0.984712}1676gitlab # [ 306.621495] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ece8663e775fc75a19587c5a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ece8663e775fc75a19587c5a: done: 0.014607 sec","job_status":"done","queue_duration_s":0.984696,"scheduling_latency_s":0.984712,"redis_calls":13,"redis_duration_s":0.0026550000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014607,"completed_at":"2026-08-16T12:36:06.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 306.661280] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"907d6975b47e78b2846b4381","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-907d6975b47e78b2846b4381: start","job_status":"start","queue_duration_s":1.000624,"scheduling_latency_s":1.000639}1678gitlab # [ 306.673930] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"907d6975b47e78b2846b4381","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-907d6975b47e78b2846b4381: done: 0.014525 sec","job_status":"done","queue_duration_s":1.000624,"scheduling_latency_s":1.000639,"redis_calls":13,"redis_duration_s":0.002642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014525,"completed_at":"2026-08-16T12:36:06.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 306.717079] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beb71786687fa0e0aed70481","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beb71786687fa0e0aed70481: start","job_status":"start","queue_duration_s":1.016517,"scheduling_latency_s":1.016532}1680gitlab # [ 306.729718] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"beb71786687fa0e0aed70481","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-beb71786687fa0e0aed70481: done: 0.01469 sec","job_status":"done","queue_duration_s":1.016517,"scheduling_latency_s":1.016532,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01469,"completed_at":"2026-08-16T12:36:06.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 306.770356] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32d242ba7239329519ac4f11","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32d242ba7239329519ac4f11: start","job_status":"start","queue_duration_s":1.032552,"scheduling_latency_s":1.032568}1682gitlab # [ 306.782781] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32d242ba7239329519ac4f11","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32d242ba7239329519ac4f11: done: 0.014426 sec","job_status":"done","queue_duration_s":1.032552,"scheduling_latency_s":1.032568,"redis_calls":13,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014426,"completed_at":"2026-08-16T12:36:06.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 306.822617] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d837dd9367b7484b7d2545c3","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d837dd9367b7484b7d2545c3: start","job_status":"start","queue_duration_s":1.048313,"scheduling_latency_s":1.048328}1684gitlab # [ 306.835269] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d837dd9367b7484b7d2545c3","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d837dd9367b7484b7d2545c3: done: 0.014852 sec","job_status":"done","queue_duration_s":1.048313,"scheduling_latency_s":1.048328,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014852,"completed_at":"2026-08-16T12:36:06.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 306.875099] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1125b73a4ef7213e22e6669","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1125b73a4ef7213e22e6669: start","job_status":"start","queue_duration_s":1.064527,"scheduling_latency_s":1.064542}1686gitlab # [ 306.887637] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1125b73a4ef7213e22e6669","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1125b73a4ef7213e22e6669: done: 0.014549 sec","job_status":"done","queue_duration_s":1.064527,"scheduling_latency_s":1.064542,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014549,"completed_at":"2026-08-16T12:36:06.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 306.927346] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11a7b4251e13150009c305b4","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11a7b4251e13150009c305b4: start","job_status":"start","queue_duration_s":1.080414,"scheduling_latency_s":1.080429}1688gitlab # [ 306.939803] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11a7b4251e13150009c305b4","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11a7b4251e13150009c305b4: done: 0.014483 sec","job_status":"done","queue_duration_s":1.080414,"scheduling_latency_s":1.080429,"redis_calls":13,"redis_duration_s":0.002639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014483,"completed_at":"2026-08-16T12:36:06.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 306.980671] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03fbc754bdebc70b2bf41cc3","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03fbc754bdebc70b2bf41cc3: start","job_status":"start","queue_duration_s":1.096228,"scheduling_latency_s":1.096244}1690gitlab # [ 306.993539] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03fbc754bdebc70b2bf41cc3","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03fbc754bdebc70b2bf41cc3: done: 0.014534 sec","job_status":"done","queue_duration_s":1.096228,"scheduling_latency_s":1.096244,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014534,"completed_at":"2026-08-16T12:36:06.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 307.032778] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3caaffcc502074f1ae465e44","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3caaffcc502074f1ae465e44: start","job_status":"start","queue_duration_s":1.112099,"scheduling_latency_s":1.112114}1692gitlab # [ 307.044997] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3caaffcc502074f1ae465e44","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3caaffcc502074f1ae465e44: done: 0.014934 sec","job_status":"done","queue_duration_s":1.112099,"scheduling_latency_s":1.112114,"redis_calls":13,"redis_duration_s":0.0028020000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014934,"completed_at":"2026-08-16T12:36:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 307.084728] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f103027fe4106974be83078f","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f103027fe4106974be83078f: start","job_status":"start","queue_duration_s":1.128387,"scheduling_latency_s":1.128403}1694gitlab # [ 307.097238] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f103027fe4106974be83078f","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f103027fe4106974be83078f: done: 0.014502 sec","job_status":"done","queue_duration_s":1.128387,"scheduling_latency_s":1.128403,"redis_calls":13,"redis_duration_s":0.002653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014502,"completed_at":"2026-08-16T12:36:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 307.136838] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99d35dee47f85c9e2080b58e","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99d35dee47f85c9e2080b58e: start","job_status":"start","queue_duration_s":1.144232,"scheduling_latency_s":1.144248}1696gitlab # [ 307.149128] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99d35dee47f85c9e2080b58e","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99d35dee47f85c9e2080b58e: done: 0.014664 sec","job_status":"done","queue_duration_s":1.144232,"scheduling_latency_s":1.144248,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014664,"completed_at":"2026-08-16T12:36:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 307.189318] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3358a758d4b7e2d92391ba2c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3358a758d4b7e2d92391ba2c: start","job_status":"start","queue_duration_s":1.160351,"scheduling_latency_s":1.160367}1698gitlab # [ 307.202131] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3358a758d4b7e2d92391ba2c","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3358a758d4b7e2d92391ba2c: done: 0.018638 sec","job_status":"done","queue_duration_s":1.160351,"scheduling_latency_s":1.160367,"redis_calls":13,"redis_duration_s":0.006467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018638,"completed_at":"2026-08-16T12:36:06.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 307.241343] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e34c17b784aecb5ac6e732d","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e34c17b784aecb5ac6e732d: start","job_status":"start","queue_duration_s":1.180378,"scheduling_latency_s":1.180394}1700gitlab # [ 307.253904] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e34c17b784aecb5ac6e732d","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e34c17b784aecb5ac6e732d: done: 0.01452 sec","job_status":"done","queue_duration_s":1.180378,"scheduling_latency_s":1.180394,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01452,"completed_at":"2026-08-16T12:36:06.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 307.293370] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0929f209b89aa896c2e605f1","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0929f209b89aa896c2e605f1: start","job_status":"start","queue_duration_s":1.196235,"scheduling_latency_s":1.19625}1702gitlab # [ 307.305542] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0929f209b89aa896c2e605f1","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0929f209b89aa896c2e605f1: done: 0.014562 sec","job_status":"done","queue_duration_s":1.196235,"scheduling_latency_s":1.19625,"redis_calls":13,"redis_duration_s":0.002652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014562,"completed_at":"2026-08-16T12:36:06.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 307.344521] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d8b9f7798d4995c5f0f70cc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d8b9f7798d4995c5f0f70cc: start","job_status":"start","queue_duration_s":1.212153,"scheduling_latency_s":1.212168}1704gitlab # [ 307.357919] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d8b9f7798d4995c5f0f70cc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d8b9f7798d4995c5f0f70cc: done: 0.014866 sec","job_status":"done","queue_duration_s":1.212153,"scheduling_latency_s":1.212168,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014866,"completed_at":"2026-08-16T12:36:06.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 307.396983] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0551ceb32df4ac70e3a3a980","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0551ceb32df4ac70e3a3a980: start","job_status":"start","queue_duration_s":1.228384,"scheduling_latency_s":1.228399}1706gitlab # [ 307.409509] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0551ceb32df4ac70e3a3a980","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0551ceb32df4ac70e3a3a980: done: 0.014578 sec","job_status":"done","queue_duration_s":1.228384,"scheduling_latency_s":1.228399,"redis_calls":13,"redis_duration_s":0.00265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014578,"completed_at":"2026-08-16T12:36:06.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707gitlab # [ 307.448416] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"554c389019ac1d9e720b354f","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-554c389019ac1d9e720b354f: start","job_status":"start","queue_duration_s":1.244305,"scheduling_latency_s":1.244321}1708gitlab # [ 307.460607] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"554c389019ac1d9e720b354f","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-554c389019ac1d9e720b354f: done: 0.014494 sec","job_status":"done","queue_duration_s":1.244305,"scheduling_latency_s":1.244321,"redis_calls":13,"redis_duration_s":0.0026290000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014494,"completed_at":"2026-08-16T12:36:06.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 307.500084] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82e25048acc41ce2cbac363a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82e25048acc41ce2cbac363a: start","job_status":"start","queue_duration_s":1.260124,"scheduling_latency_s":1.26014}1710gitlab # [ 307.512302] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82e25048acc41ce2cbac363a","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82e25048acc41ce2cbac363a: done: 0.016429 sec","job_status":"done","queue_duration_s":1.260124,"scheduling_latency_s":1.26014,"redis_calls":13,"redis_duration_s":0.004401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016429,"completed_at":"2026-08-16T12:36:06.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 307.551481] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b70af86508e71a4d454bc1c9","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b70af86508e71a4d454bc1c9: start","job_status":"start","queue_duration_s":1.277827,"scheduling_latency_s":1.277843}1712gitlab # [ 307.565238] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b70af86508e71a4d454bc1c9","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b70af86508e71a4d454bc1c9: done: 0.01464 sec","job_status":"done","queue_duration_s":1.277827,"scheduling_latency_s":1.277843,"redis_calls":13,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-08-16T12:36:06.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 307.604648] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03a26fff7dd0b683140b6e6","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03a26fff7dd0b683140b6e6: start","job_status":"start","queue_duration_s":1.293808,"scheduling_latency_s":1.293823}1714gitlab # [ 307.617118] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03a26fff7dd0b683140b6e6","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03a26fff7dd0b683140b6e6: done: 0.014862 sec","job_status":"done","queue_duration_s":1.293808,"scheduling_latency_s":1.293823,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014862,"completed_at":"2026-08-16T12:36:06.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 307.656475] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820181d600a133af27b22217","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820181d600a133af27b22217: start","job_status":"start","queue_duration_s":1.309978,"scheduling_latency_s":1.309994}1716gitlab # [ 307.668919] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820181d600a133af27b22217","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820181d600a133af27b22217: done: 0.0147 sec","job_status":"done","queue_duration_s":1.309978,"scheduling_latency_s":1.309994,"redis_calls":13,"redis_duration_s":0.00275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0147,"completed_at":"2026-08-16T12:36:06.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 307.708535] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90579293280886a4466bf902","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90579293280886a4466bf902: start","job_status":"start","queue_duration_s":1.32603,"scheduling_latency_s":1.326046}1718gitlab # [ 307.720698] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90579293280886a4466bf902","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90579293280886a4466bf902: done: 0.01464 sec","job_status":"done","queue_duration_s":1.32603,"scheduling_latency_s":1.326046,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-08-16T12:36:06.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 307.760155] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eacbada9ec9c9938990e0e64","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eacbada9ec9c9938990e0e64: start","job_status":"start","queue_duration_s":1.342014,"scheduling_latency_s":1.34203}1720gitlab # [ 307.773412] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eacbada9ec9c9938990e0e64","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eacbada9ec9c9938990e0e64: done: 0.015079 sec","job_status":"done","queue_duration_s":1.342014,"scheduling_latency_s":1.34203,"redis_calls":13,"redis_duration_s":0.002868,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015079,"completed_at":"2026-08-16T12:36:06.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 307.812517] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b64d3855d8f7dac0e86457cc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b64d3855d8f7dac0e86457cc: start","job_status":"start","queue_duration_s":1.358319,"scheduling_latency_s":1.358334}1722gitlab # [ 307.825003] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b64d3855d8f7dac0e86457cc","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b64d3855d8f7dac0e86457cc: done: 0.018318 sec","job_status":"done","queue_duration_s":1.358319,"scheduling_latency_s":1.358334,"redis_calls":13,"redis_duration_s":0.002524,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001657,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018318,"completed_at":"2026-08-16T12:36:06.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 307.864583] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"110c347074ac8532a8caf084","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-110c347074ac8532a8caf084: start","job_status":"start","queue_duration_s":1.378763,"scheduling_latency_s":1.378778}1724gitlab # [ 307.877127] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"110c347074ac8532a8caf084","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-110c347074ac8532a8caf084: done: 0.017213 sec","job_status":"done","queue_duration_s":1.378763,"scheduling_latency_s":1.378778,"redis_calls":13,"redis_duration_s":0.0046700000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017213,"completed_at":"2026-08-16T12:36:06.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 307.916725] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51ddf2b2c838a9821646f0aa","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51ddf2b2c838a9821646f0aa: start","job_status":"start","queue_duration_s":1.400416,"scheduling_latency_s":1.400433}1726gitlab # [ 307.929095] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51ddf2b2c838a9821646f0aa","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51ddf2b2c838a9821646f0aa: done: 0.015195 sec","job_status":"done","queue_duration_s":1.400416,"scheduling_latency_s":1.400433,"redis_calls":13,"redis_duration_s":0.002594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015195,"completed_at":"2026-08-16T12:36:06.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 307.969409] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1169567725df0c37e987258","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1169567725df0c37e987258: start","job_status":"start","queue_duration_s":1.416998,"scheduling_latency_s":1.417014}1728gitlab # [ 307.981602] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1169567725df0c37e987258","created_at":"2026-08-16T12:36:05.184Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-42ea6d8b22ba432a","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"70d579eba55ad163c574f652fbdb8f80","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.298Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1169567725df0c37e987258: done: 0.014721 sec","job_status":"done","queue_duration_s":1.416998,"scheduling_latency_s":1.417014,"redis_calls":13,"redis_duration_s":0.0026509999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014721,"completed_at":"2026-08-16T12:36:06.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729gitlab # [ 308.021306] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"1ae124043e1e10eabaa9acb7","created_at":"2026-08-16T12:36:05.796Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-04aa2f40c591405b","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"f5aa61f3c707d7526111d3c93f3551c7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.805Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-1ae124043e1e10eabaa9acb7: start","job_status":"start","queue_duration_s":0.926845,"scheduling_latency_s":0.92686}1730gitlab # [ 308.034484] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:06.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"1ae124043e1e10eabaa9acb7","created_at":"2026-08-16T12:36:05.796Z","trace_propagation_headers":{"sentry-trace":"d5148ba9bbcf468ab48c2af30b2836ca-04aa2f40c591405b","baggage":"sentry-trace_id=d5148ba9bbcf468ab48c2af30b2836ca,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"f5aa61f3c707d7526111d3c93f3551c7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:05.805Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-1ae124043e1e10eabaa9acb7: done: 0.035068 sec","job_status":"done","queue_duration_s":0.926845,"scheduling_latency_s":0.92686,"redis_calls":13,"redis_duration_s":0.003271,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000545,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001542,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003419,"duration_s":0.035068,"completed_at":"2026-08-16T12:36:06.766Z","load_balancing_strategy":"primary","db_duration_s":0.007503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 309.154154] redis[794]: 10 changes in 300 seconds. Saving...1732gitlab # [ 309.157510] redis[794]: Background saving started by pid 33071733gitlab # [ 309.165671] redis[3307]: BGSAVE done, 460 keys saved, 0 keys skipped, 122804 bytes written.1734gitlab # [ 309.170913] redis[3307]: DB saved on disk1735gitlab # [ 309.173250] redis[3307]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1736gitlab # [ 309.255215] redis[794]: Background saving terminated with success1737gitlab # [ 310.616119] postgres[868]: [868] LOG: checkpoint starting: time1738gitlab # [ 311.787589] gitaly[888]: time="2026-08-16T12:36:12.671Z" level=info msg="burden monitor stats" pid=8881739gitlab # [ 314.777899] postgres[3308]: [3308] ERROR: relation "table_without_models" does not exist1740gitlab # [ 314.778211] postgres[3308]: [3308] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1741gitlab # [ 320.419068] runuser[2973]: pam_unix(runuser:session): session closed for user gitlab1742gitlab # [ 320.421036] setup-gitlab-start[2955]: + systemctl restart gitlab-sidekiq.service1743gitlab # [ 320.470597] systemd[1]: Stopping gitlab-sidekiq.service...1744gitlab # [ 320.483126] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.367Z","message":"Shutting down"}1745gitlab # [ 320.487469] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.367Z","message":"Scheduler exiting..."}1746gitlab # [ 320.491779] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.368Z","message":"Terminating quiet threads for default capsule"}1747gitlab # [ 320.496843] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.368Z","message":"Scheduler exiting..."}1748gitlab # [ 320.990984] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.875Z","message":"Bye!"}1749gitlab # [ 321.033764] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T12:36:21.918Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2014,"worker_id":"sidekiq_0","memwd_rss_bytes":953450496,"retry":0}1750gitlab # [ 322.499632] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1751gitlab # [ 322.500357] systemd[1]: Stopped gitlab-sidekiq.service.1752gitlab # [ 322.505433] systemd[1]: gitlab-sidekiq.service: Consumed 1min 53.694s CPU time over 3min 20.386s wall clock time, 969.7M memory peak, 7.8M read from disk.1753gitlab # [ 322.511618] systemd[1]: Started gitlab-sidekiq.service.1754gitlab # [ 322.515237] setup-gitlab-start[2955]: + mkdir -p /var/lib/secrets1755gitlab # [ 322.518580] setup-gitlab-start[2955]: + echo nixbot-test-token-of-20-chars1756gitlab # [ 322.522068] setup-gitlab-start[2955]: + chmod 644 /var/lib/secrets/gitlab-token1757gitlab # [ 322.528588] setup-gitlab-start[2955]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1758gitlab # [ 323.879563] gitaly[888]: time="2026-08-16T12:36:24.763Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:34.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:24.762" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 323.902242] gitaly[888]: time="2026-08-16T12:36:24.764Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:34.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:24.762" grpc.time_ms=1.675 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 324.201462] gitaly[888]: time="2026-08-16T12:36:25.086Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.086" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 324.228943] gitaly[888]: time="2026-08-16T12:36:25.086Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.086" grpc.time_ms=0.594 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 324.280892] gitaly[888]: time="2026-08-16T12:36:25.166Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX diskcache=6a919b61-7fee-475a-8712-0a13ea0da5fe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T12:36:35.020" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.102" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 324.309515] gitaly[888]: time="2026-08-16T12:36:25.166Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=41 command.spawn_token_fork_ms=6 command.system_time_ms=22 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T12:36:35.020" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.102" grpc.time_ms=64.237 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 324.338589] gitaly[888]: time="2026-08-16T12:36:25.189Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.107" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.187" pid=888 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1765gitlab # [ 324.357247] gitaly[888]: time="2026-08-16T12:36:25.189Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.107" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.187" grpc.time_ms=1.416 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 324.374989] gitaly[888]: time="2026-08-16T12:36:25.218Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:36:35.116" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.197" grpc.time_ms=21.232 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 324.447330] gitaly[888]: time="2026-08-16T12:36:25.332Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.332" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 324.478494] gitaly[888]: time="2026-08-16T12:36:25.332Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.332" grpc.time_ms=0.563 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 324.508199] gitaly[888]: time="2026-08-16T12:36:25.375Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX diskcache=a4eb9140-2c00-4e21-bd3a-a6b89431e271 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T12:36:35.254" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.335" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 324.530706] gitaly[888]: time="2026-08-16T12:36:25.376Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T12:36:35.254" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.335" grpc.time_ms=40.862 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 324.557054] gitaly[888]: time="2026-08-16T12:36:25.385Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.384" pid=888 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1772gitlab # [ 324.574456] gitaly[888]: time="2026-08-16T12:36:25.386Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.384" grpc.time_ms=1.622 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 324.589899] gitaly[888]: time="2026-08-16T12:36:25.404Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:36:35.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.391" grpc.time_ms=13.597 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 324.607235] gitaly[888]: time="2026-08-16T12:36:25.451Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:36:35.070" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.450" grpc.time_ms=0.294 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 324.620780] gitaly[888]: time="2026-08-16T12:36:25.462Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T12:36:35.081" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:25.461" grpc.time_ms=0.402 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 325.512984] gitaly[888]: time="2026-08-16T12:36:26.396Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595ERNFNNVMHHXRSEFT9VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:36:36.298" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:26.379" grpc.time_ms=17.414 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 327.579634] sidekiq-cluster[3363]: {"severity":"INFO","time":"2026-08-16T12:36:28.436Z","message":"Starting cluster with 1 processes"}1778gitlab # [ 327.610024] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:28 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 50471779gitlab # [ 327.616542] setup-gitlab-start[2955]: + mkdir -p /tmp/test-flake1780gitlab # [ 327.620001] setup-gitlab-start[2955]: + cd /tmp/test-flake1781gitlab # [ 327.622458] setup-gitlab-start[2955]: + git init -b master1782gitlab # [ 327.648826] setup-gitlab-start[3432]: Initialized empty Git repository in /tmp/test-flake/.git/1783gitlab # [ 327.652433] setup-gitlab-start[2955]: + git config user.name test1784gitlab # [ 327.655697] setup-gitlab-start[2955]: + git config user.email test@example.com1785gitlab # [ 327.662158] setup-gitlab-start[2955]: + cat1786gitlab # [ 327.667341] setup-gitlab-start[2955]: + git add flake.nix1787gitlab # [ 327.677015] setup-gitlab-start[2955]: + git commit -m 'initial commit'1788gitlab # [ 327.706858] setup-gitlab-start[3437]: [master (root-commit) c447fe1] initial commit1789gitlab # [ 327.711228] setup-gitlab-start[3437]: 1 file changed, 10 insertions(+)1790gitlab # [ 327.714115] setup-gitlab-start[3437]: create mode 100644 flake.nix1791gitlab # [ 327.716909] setup-gitlab-start[2955]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1792gitlab # [ 327.723002] setup-gitlab-start[2955]: + git push -u origin master1793gitlab # [ 327.839084] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 691794gitlab # [ 328.639521] gitaly[888]: time="2026-08-16T12:36:29.523Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0595KXW1QNS65EH4MGKJ5X4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:29.504" grpc.time_ms=18.754 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 328.640891] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 7921796gitlab # [ 329.138475] gitaly[888]: time="2026-08-16T12:36:30.023Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:36:39.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:30.006" grpc.time_ms=17.099 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 329.273971] gitaly[888]: time="2026-08-16T12:36:30.159Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T12:37:00.038" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T12:36:30.138" grpc.time_ms=19.809 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 329.347118] gitaly[888]: time="2026-08-16T12:36:30.232Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0595MRJSCPEQQ0P9EBM17FP duration_ms=401ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/allowed"1799gitlab # [ 329.415368] gitaly[888]: time="2026-08-16T12:36:30.300Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0595MRJSCPEQQ0P9EBM17FP duration_ms=66ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/pre_receive"1800gitlab # [ 329.429028] gitaly[888]: time="2026-08-16T12:36:30.301Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:29.827" grpc.time_ms=473.023 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1801gitlab # [ 329.497331] gitaly[888]: time="2026-08-16T12:36:30.382Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:30.379" grpc.time_ms=2.996 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1802gitlab # [ 329.585874] gitaly[888]: time="2026-08-16T12:36:30.471Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:30.469" grpc.time_ms=1.139 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1803gitlab # [ 329.669692] gitaly[888]: time="2026-08-16T12:36:30.553Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:30.552" grpc.time_ms=1.138 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1804gitlab # [ 329.851699] gitaly[888]: time="2026-08-16T12:36:30.736Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:36:40.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:30.715" grpc.time_ms=20.599 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 329.941864] gitaly[888]: time="2026-08-16T12:36:30.826Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=5 command.system_time_ms=24 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T12:36:40.036" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:30.786" grpc.time_ms=39.854 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 329.979330] gitaly[888]: time="2026-08-16T12:36:30.861Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0595MRJSCPEQQ0P9EBM17FP duration_ms=256ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/post_receive"1807gitlab # [ 329.985638] gitaly[888]: time="2026-08-16T12:36:30.862Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:30.604" grpc.time_ms=258.531 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1808gitlab # [ 330.007755] gitaly[888]: time="2026-08-16T12:36:30.880Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP diskcache=aa5053c1-3b68-4fb5-a2ff-635e8abd7b3b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:29.718" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1809gitlab # [ 330.028469] setup-gitlab-start[3441]: To http://gitlab/root/test-flake.git1810gitlab # [ 330.030906] setup-gitlab-start[3441]: * [new branch] master -> master1811gitlab # [ 330.032770] setup-gitlab-start[3441]: branch 'master' set up to track 'origin/master'.1812gitlab # [ 330.035251] gitlab-workhorse[821]: time="2026-08-16T12:36:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521813gitlab # [ 330.038786] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:30 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12941814gitlab # [ 330.042864] systemd[1]: Finished setup-gitlab.service.1815gitlab # [ 330.044229] gitaly[888]: time="2026-08-16T12:36:30.880Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=353 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13291 command.oublock=32 command.real_time_ms=1153 command.spawn_token_fork_ms=1 command.system_time_ms=193 command.user_time_ms=160 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:29.718" grpc.time_ms=1162.353 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1816gitlab # [ 330.065423] systemd[1]: Starting nixbot CI service...1817gitlab: (finished: waiting for unit setup-gitlab.service, in 331.61 seconds)1818gitlab: waiting for unit nixbot.service1819gitlab # [ 331.202865] nixbot[3535]: {"ts": "2026-08-16T12:36:32.087Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1820gitlab # [ 331.239844] nixbot[3535]: {"ts": "2026-08-16T12:36:32.124Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1821gitlab # [ 331.277841] nixbot[3535]: {"ts": "2026-08-16T12:36:32.162Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1822gitlab # [ 331.284640] nixbot[3535]: {"ts": "2026-08-16T12:36:32.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1823gitlab # [ 331.291912] nixbot[3535]: {"ts": "2026-08-16T12:36:32.174Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1824gitlab # [ 331.298779] nixbot[3535]: {"ts": "2026-08-16T12:36:32.183Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1825gitlab # [ 331.305773] nixbot[3535]: {"ts": "2026-08-16T12:36:32.190Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1826gitlab # [ 331.312359] nixbot[3535]: {"ts": "2026-08-16T12:36:32.193Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1827gitlab # [ 331.318831] nixbot[3535]: {"ts": "2026-08-16T12:36:32.203Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1828gitlab # [ 331.325586] nixbot[3535]: {"ts": "2026-08-16T12:36:32.206Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1829gitlab # [ 331.332435] nixbot[3535]: {"ts": "2026-08-16T12:36:32.215Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1830gitlab # [ 331.341207] nixbot[3535]: {"ts": "2026-08-16T12:36:32.226Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1831gitlab # [ 331.348628] nixbot[3535]: {"ts": "2026-08-16T12:36:32.231Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1832gitlab # [ 331.355424] nixbot[3535]: {"ts": "2026-08-16T12:36:32.234Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1833gitlab # [ 331.361999] nixbot[3535]: {"ts": "2026-08-16T12:36:32.240Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1834gitlab # [ 331.368306] nixbot[3535]: {"ts": "2026-08-16T12:36:32.243Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1835gitlab # [ 331.373853] nixbot[3535]: {"ts": "2026-08-16T12:36:32.246Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1836gitlab # [ 331.379536] nixbot[3535]: {"ts": "2026-08-16T12:36:32.249Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1837gitlab # [ 331.384844] nixbot[3535]: {"ts": "2026-08-16T12:36:32.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1838gitlab # [ 331.389972] nixbot[3535]: {"ts": "2026-08-16T12:36:32.258Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1839gitlab # [ 331.395397] nixbot[3535]: {"ts": "2026-08-16T12:36:32.261Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1840gitlab # [ 331.400413] nixbot[3535]: {"ts": "2026-08-16T12:36:32.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1841gitlab # [ 331.404993] nixbot[3535]: {"ts": "2026-08-16T12:36:32.271Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1842gitlab # [ 331.409515] nixbot[3535]: {"ts": "2026-08-16T12:36:32.275Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1843gitlab # [ 331.413624] nixbot[3535]: {"ts": "2026-08-16T12:36:32.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1844gitlab # [ 331.739260] nixbot[3535]: INFO: Started server process [3535]1845gitlab # [ 331.742727] nixbot[3535]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1846gitlab # [ 331.760521] nixbot[3535]: INFO: ::ffff:127.0.0.1:46476 - "GET /health HTTP/1.1" 200 OK1847gitlab # [ 331.771122] systemd[1]: Started nixbot CI service.1848gitlab # [ 331.773134] systemd[1]: Reached target Multi-User System.1849gitlab # [ 331.775778] systemd[1]: Startup finished in 776ms (kernel) + 4.240s (initrd) + 5min 26.757s (userspace) = 5min 31.775s.1850gitlab # [ 332.158813] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:33 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3981851gitlab # [ 332.166504] nixbot[3535]: {"ts": "2026-08-16T12:36:33.046Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1852gitlab # [ 332.185732] nixbot[3535]: {"ts": "2026-08-16T12:36:33.070Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1853gitlab: (finished: waiting for unit nixbot.service, in 1.08 seconds)1854gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1855gitlab # [ 332.262210] nixbot[3535]: INFO: ::ffff:127.0.0.1:45196 - "GET /health HTTP/1.1" 200 OK1856gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1857subtest: project discovered and webhook registered1858gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1859gitlab # [ 332.384434] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1841860gitlab # [ 332.391826] nixbot[3535]: {"ts": "2026-08-16T12:36:33.271Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1861gitlab # [ 332.399171] nixbot[3535]: {"ts": "2026-08-16T12:36:33.274Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1862gitlab # [ 332.440060] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1281863gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1864gitlab # [ 332.659201] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2611865gitlab # [ 332.666089] nixbot[3535]: {"ts": "2026-08-16T12:36:33.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1866gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1867gitlab # [ 333.582391] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 9101868gitlab # [ 333.591598] nixbot[3535]: {"ts": "2026-08-16T12:36:34.469Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1869gitlab # [ 333.656579] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 581870gitlab # [ 333.672360] nixbot[3535]: {"ts": "2026-08-16T12:36:34.557Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1871gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.24 seconds)1872(finished: subtest: project discovered and webhook registered, in 1.42 seconds)1873subtest: push delivers the webhook1874gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1875gitlab # [ 333.681769] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1831876gitlab # [ 333.754323] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 771877gitlab # [ 333.762088] nixbot[3535]: {"ts": "2026-08-16T12:36:34.640Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1878gitlab # [ 333.794827] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471879gitlab # [ 333.837566] gitaly[888]: time="2026-08-16T12:36:34.721Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595SPQ4ZEPR814XJARYPNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T12:37:04.600" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:34.701" grpc.time_ms=19.854 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 333.878705] gitaly[888]: time="2026-08-16T12:36:34.734Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595SPQ4ZEPR814XJARYPNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:04.633" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:34.733" grpc.time_ms=0.681 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881gitlab # [ 333.904922] gitaly[888]: time="2026-08-16T12:36:34.750Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595SPQ4ZEPR814XJARYPNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T12:36:44.007" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:34.737" grpc.time_ms=12.516 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 333.932132] nixbot[3535]: {"ts": "2026-08-16T12:36:34.783Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1883gitlab # [ 333.936554] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1341884gitlab # [ 333.987228] nixbot[3535]: {"ts": "2026-08-16T12:36:34.872Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1885gitlab # [ 333.995835] nixbot[3535]: {"ts": "2026-08-16T12:36:34.877Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1886gitlab # [ 334.003819] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 861887gitlab # Enumerating objects: 5, done.1888gitlab # [ 334.011638] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1961889gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)[ 334.019375] gitaly[888]: time="2026-08-16T12:36:34.882Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0595SQY8M5DVGJ7FFEVVB8Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:34.868" grpc.time_ms=13.257 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1890gitlab # Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1891gitlab # Delta compression using up to 4 threads1892gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1893gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1894gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1895gitlab # [ 334.110002] gitaly[888]: time="2026-08-16T12:36:34.995Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0595SZ90HYTX9HJE5GF2XYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:34.981" grpc.time_ms=13.662 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 334.140478] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 731897gitlab # [ 334.215075] gitaly[888]: time="2026-08-16T12:36:35.100Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0595T1NQ8W0RQKCT9QPKHT0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.090" pid=888 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1898gitlab # [ 334.237121] gitaly[888]: time="2026-08-16T12:36:35.101Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T1NQ8W0RQKCT9QPKHT0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.090" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1899gitlab # [ 334.261628] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131900gitlab # [ 334.264835] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1051901gitlab # [ 334.267989] gitaly[888]: time="2026-08-16T12:36:35.101Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T1NQ8W0RQKCT9QPKHT0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.090" grpc.time_ms=11.689 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 334.289889] gitaly[888]: time="2026-08-16T12:36:35.144Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T12:37:05.035" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T12:36:35.136" grpc.time_ms=8.669 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 334.311162] gitaly[888]: time="2026-08-16T12:36:35.161Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0595T01Z9MP7240Z957ZN7T duration_ms=82ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/allowed"1904gitlab # [ 334.314620] gitaly[888]: time="2026-08-16T12:36:35.187Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0595T525WE51J7SYZ69PZ1T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.170" pid=888 remote_ip="2001:db8:1::1" request_sha=494c47681ba30e2ef2a93a912dc657561495f627 response_bytes=227 span.kind=server system=grpc1905gitlab # [ 334.325535] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2271906gitlab # [ 334.327385] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 227 "" "git/2.55.0" 821907gitlab # [ 334.329563] gitaly[888]: time="2026-08-16T12:36:35.187Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T525WE51J7SYZ69PZ1T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.170" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1908gitlab # [ 334.343912] gitaly[888]: time="2026-08-16T12:36:35.188Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T525WE51J7SYZ69PZ1T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.170" grpc.time_ms=17.215 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 334.359224] gitaly[888]: time="2026-08-16T12:36:35.191Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0595T01Z9MP7240Z957ZN7T duration_ms=29ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/pre_receive"1910gitlab # [ 334.362239] gitaly[888]: time="2026-08-16T12:36:35.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:35.078" grpc.time_ms=113.468 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1911gitlab # [ 334.373210] gitaly[888]: time="2026-08-16T12:36:35.222Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:35.222" grpc.time_ms=0.534 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1912gitlab # [ 334.384465] gitaly[888]: time="2026-08-16T12:36:35.254Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:35.254" grpc.time_ms=0.402 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1913gitlab # [ 334.403967] gitaly[888]: time="2026-08-16T12:36:35.289Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:35.288" grpc.time_ms=0.903 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1914gitlab # [ 334.423158] gitaly[888]: time="2026-08-16T12:36:35.308Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0595T914XMSTT3H79JWR05R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.301" grpc.time_ms=7.306 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 334.436967] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 741916gitlab # [ 334.478647] gitaly[888]: time="2026-08-16T12:36:35.363Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0595T01Z9MP7240Z957ZN7T duration_ms=43ns method=POST pid=888 status=200 url="http://unix/api/v4/internal/post_receive"1917gitlab # [ 334.485059] gitaly[888]: time="2026-08-16T12:36:35.364Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:35.320" grpc.time_ms=44.535 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1918gitlab # [ 334.503561] gitaly[888]: time="2026-08-16T12:36:35.388Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T diskcache=bfcd0383-e864-4703-a3cd-dd854ec4000e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.012" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1919gitlab # To http://gitlab/root/test-flake.git1920gitlab # [ 334.515652] gitaly[888]: time="2026-08-16T12:36:35.389Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=164 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13016 command.oublock=32 command.real_time_ms=370 command.spawn_token_fork_ms=0 command.system_time_ms=57 command.user_time_ms=107 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.012" grpc.time_ms=376.695 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1921gitlab # c447fe1..af316e3 [ 334.530228] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521922gitlab # master -> master[ 334.532375] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4441923gitlab # 1924gitlab # [ 334.534374] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671925gitlab # [ 334.536390] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1041926gitlab # [ 334.538226] gitaly[888]: time="2026-08-16T12:36:35.414Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TBEHFM1XPQD537Y51E9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.400" pid=888 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1927gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.87 seconds)1928gitlab: must succeed: git -C /tmp/test-flake rev-parse master1929gitlab # [ 334.548128] gitaly[888]: time="2026-08-16T12:36:35.414Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TBEHFM1XPQD537Y51E9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.400" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1930gitlab # [ 334.564255] gitaly[888]: time="2026-08-16T12:36:35.414Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TBEHFM1XPQD537Y51E9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.400" grpc.time_ms=13.686 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1933gitlab # [ 334.607399] gitaly[888]: time="2026-08-16T12:36:35.492Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TERC06RM9W0YDMFTPK6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.476" pid=888 remote_ip="2001:db8:1::1" request_sha=b640834fe5a9bde3e90aac2c275b42cd6a2ffba7 response_bytes=338 span.kind=server system=grpc1934gitlab # [ 334.619726] gitaly[888]: time="2026-08-16T12:36:35.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TERC06RM9W0YDMFTPK6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.476" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1935gitlab # [ 334.636836] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381936gitlab # [ 334.638763] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 761937gitlab # [ 334.640815] gitaly[888]: time="2026-08-16T12:36:35.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TERC06RM9W0YDMFTPK6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.476" grpc.time_ms=16.847 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1938gitlab # [ 334.673381] nixbot[3535]: INFO: ::ffff:127.0.0.1:45212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.09 seconds)1940gitlab # [ 334.753873] gitaly[888]: time="2026-08-16T12:36:35.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595TKRKEH0K5YFF7W22ZV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.624" grpc.time_ms=14.422 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1941gitlab # [ 334.782562] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 621942gitlab # [ 334.838857] gitaly[888]: time="2026-08-16T12:36:35.723Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TNR2ZQZFQM1RXDY1ZH0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.691" pid=888 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1943gitlab # [ 334.871068] gitaly[888]: time="2026-08-16T12:36:35.723Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TNR2ZQZFQM1RXDY1ZH0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.691" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1944gitlab # [ 334.899586] gitlab-workhorse[821]: time="2026-08-16T12:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091945gitlab # [ 334.903263] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 831946gitlab # [ 334.906922] gitaly[888]: time="2026-08-16T12:36:35.723Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TNR2ZQZFQM1RXDY1ZH0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:35.691" grpc.time_ms=31.518 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc1947gitlab # [ 334.968901] gitaly[888]: time="2026-08-16T12:36:35.854Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:05.751" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:35.852" grpc.time_ms=1.019 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 335.053671] gitaly[888]: time="2026-08-16T12:36:35.938Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T12:37:05.819" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:35.920" grpc.time_ms=18.051 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 335.093477] gitaly[888]: time="2026-08-16T12:36:35.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:36:45.229" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:35.959" grpc.time_ms=18.45 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 335.121531] gitaly[888]: time="2026-08-16T12:36:36.002Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:36:45.258" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:35.988" grpc.time_ms=13.968 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 335.236681] gitaly[888]: time="2026-08-16T12:36:36.121Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T12:36:46.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:36.120" grpc.time_ms=0.678 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 335.263728] gitaly[888]: time="2026-08-16T12:36:36.148Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T12:36:46.022" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:36.132" grpc.time_ms=16.323 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953gitlab # [ 335.331430] gitaly[888]: time="2026-08-16T12:36:36.216Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:36.215" grpc.time_ms=0.598 pid=888 span.kind=server system=grpc1954gitlab # [ 335.380640] gitaly[888]: time="2026-08-16T12:36:36.265Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:36:36.264" grpc.time_ms=0.811 pid=888 span.kind=server system=grpc1955gitlab # [ 335.399368] gitaly[888]: time="2026-08-16T12:36:36.280Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB diskcache=72af3209-f024-4377-a4cb-bfea6f5ade85 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:36:46.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:36.151" pid=888 ref=refs/keep-around/c447fe13d60a1bf567684641170d926aad416701 remote_ip="2001:db8:1::1" revision=c447fe13d60a1bf567684641170d926aad416701 span.kind=server system=grpc username=root1956gitlab # [ 335.418619] gitaly[888]: time="2026-08-16T12:36:36.281Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=126 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5604 command.oublock=8 command.real_time_ms=123 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=73 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:36:46.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:36:36.151" grpc.time_ms=129.585 pid=888 ref=refs/keep-around/c447fe13d60a1bf567684641170d926aad416701 remote_ip="2001:db8:1::1" revision=c447fe13d60a1bf567684641170d926aad416701 span.kind=server system=grpc username=root1957gitlab # [ 335.440458] gitaly[888]: time="2026-08-16T12:36:36.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:06.185" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:36.286" grpc.time_ms=0.519 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 335.633086] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7361959gitlab # [ 335.635688] nixbot[3535]: {"ts": "2026-08-16T12:36:36.520Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}1960gitlab # [ 335.645263] nixbot[3535]: {"ts": "2026-08-16T12:36:36.530Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-c447fe13d60a-0"}1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1962gitlab # [ 335.719394] nixbot[3535]: INFO: ::ffff:127.0.0.1:45216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)1964gitlab # [ 335.727793] systemd[1]: Started Nix Daemon.1965gitlab # [ 335.790047] nix-daemon[3751]: accepted connection from pid 3742, user nixbot1966gitlab # [ 335.924173] nix-daemon[3751]: accepted connection from pid 3758, user nixbot1967gitlab # [ 335.946607] nixbot[3535]: {"ts": "2026-08-16T12:36:36.831Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-c447fe13d60a-0", "argv0": "bwrap"}1968gitlab # [ 336.189458] nix-daemon[3751]: accepted connection from pid 3768, user nixbot1969gitlab # [ 336.301745] nix-daemon[3751]: accepted connection from pid 3778, user nixbot1970gitlab # [ 336.325288] nix-daemon[3751]: accepted connection from pid 3768, user nixbot1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)1973gitlab # [ 336.779353] nixbot[3535]: INFO: ::ffff:127.0.0.1:45218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1975gitlab # [ 337.836717] nixbot[3535]: INFO: ::ffff:127.0.0.1:45228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1978gitlab # [ 338.892671] nixbot[3535]: INFO: ::ffff:127.0.0.1:45230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1981gitlab # [ 339.947003] nixbot[3535]: INFO: ::ffff:127.0.0.1:45244 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1984gitlab # [ 340.933678] gitaly[888]: time="2026-08-16T12:36:41.817Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05960KHCDFRKPFP87BXGH40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:11.715" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:41.816" grpc.time_ms=1.422 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)1986gitlab # [ 340.998277] nixbot[3535]: INFO: ::ffff:127.0.0.1:33566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK1987gitlab # [ 341.056750] gitaly[888]: time="2026-08-16T12:36:41.941Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05960KHCDFRKPFP87BXGH40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:36:51.193" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:41.924" grpc.time_ms=17.511 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 341.205019] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3751989gitlab # [ 341.220394] nixbot[3535]: {"ts": "2026-08-16T12:36:42.090Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}1990gitlab # [ 341.324263] gitaly[888]: time="2026-08-16T12:36:42.209Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05960ZJWK2DG1VPA1D106NF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:12.007" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:42.207" grpc.time_ms=1.037 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 341.525813] gitaly[888]: time="2026-08-16T12:36:42.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05960ZJWK2DG1VPA1D106NF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:36:52.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:42.394" grpc.time_ms=15.67 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 341.831510] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 6161993gitlab # [ 341.846128] nixbot[3535]: {"ts": "2026-08-16T12:36:42.726Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}1994gitlab # [ 341.919966] gitaly[888]: time="2026-08-16T12:36:42.805Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05961KTQTM89X0FQECVNKGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:37:12.602" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:36:42.803" grpc.time_ms=1.131 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'1996gitlab # [ 341.966753] gitaly[888]: time="2026-08-16T12:36:42.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05961KTQTM89X0FQECVNKGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:36:52.086" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:36:42.836" grpc.time_ms=13.7 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 342.027318] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1651998gitlab # [ 342.034837] nixbot[3535]: {"ts": "2026-08-16T12:36:42.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}1999gitlab # [ 342.057596] nixbot[3535]: INFO: ::ffff:127.0.0.1:33572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2001gitlab # [ 342.185809] nix-daemon[3751]: accepted connection from pid 3819, user nixbot2002gitlab # [ 342.385072] gitaly[888]: time="2026-08-16T12:36:43.270Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M059620J862G9KFC057302TD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:43.251" grpc.time_ms=18.23 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2003gitlab # [ 342.427923] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1162004gitlab # [ 342.479761] gitaly[888]: time="2026-08-16T12:36:43.364Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M059624AVDHF6DCJCYPHVD7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:43.351" pid=888 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2005gitlab # [ 342.512766] gitaly[888]: time="2026-08-16T12:36:43.365Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M059624AVDHF6DCJCYPHVD7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:43.351" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2006gitlab # [ 342.550522] gitlab-workhorse[821]: time="2026-08-16T12:36:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672007gitlab # [ 342.554939] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:36:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 912008gitlab # [ 342.559824] gitaly[888]: time="2026-08-16T12:36:43.365Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M059624AVDHF6DCJCYPHVD7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:36:43.351" grpc.time_ms=13.735 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2009gitlab # [ 342.605295] nix-daemon[3751]: accepted connection from pid 3844, user nixbot2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2011gitlab # [ 343.116370] nixbot[3535]: INFO: ::ffff:127.0.0.1:33574 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2014gitlab # [ 344.171773] nixbot[3535]: INFO: ::ffff:127.0.0.1:33580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2017gitlab # [ 345.227821] nixbot[3535]: INFO: ::ffff:127.0.0.1:33586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2020gitlab # [ 346.282422] nixbot[3535]: INFO: ::ffff:127.0.0.1:33592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2023gitlab # [ 347.337271] nixbot[3535]: INFO: ::ffff:127.0.0.1:33604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2027gitlab # [ 348.393483] nixbot[3535]: INFO: ::ffff:127.0.0.1:33612 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2030gitlab # [ 349.447945] nixbot[3535]: INFO: ::ffff:127.0.0.1:33616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2032gitlab # [ 350.501470] nixbot[3535]: INFO: ::ffff:127.0.0.1:33622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2036gitlab # [ 351.556558] nixbot[3535]: INFO: ::ffff:127.0.0.1:38912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2039gitlab # [ 352.608958] nixbot[3535]: INFO: ::ffff:127.0.0.1:38928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2042gitlab # [ 353.661658] nixbot[3535]: INFO: ::ffff:127.0.0.1:38944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2045gitlab # [ 354.714604] nixbot[3535]: INFO: ::ffff:127.0.0.1:38956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2048gitlab # [ 355.766907] nixbot[3535]: INFO: ::ffff:127.0.0.1:38966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2050gitlab # [ 356.818888] nixbot[3535]: INFO: ::ffff:127.0.0.1:38972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2053gitlab # [ 357.872338] nixbot[3535]: INFO: ::ffff:127.0.0.1:38984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2056gitlab # [ 358.926751] nixbot[3535]: INFO: ::ffff:127.0.0.1:38986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2057gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2060gitlab # [ 359.982171] nixbot[3535]: INFO: ::ffff:127.0.0.1:38998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2063gitlab # [ 361.035707] nixbot[3535]: INFO: ::ffff:127.0.0.1:52950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2065gitlab # [ 362.087806] nixbot[3535]: INFO: ::ffff:127.0.0.1:52952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2067gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2068gitlab # [ 363.141203] nixbot[3535]: INFO: ::ffff:127.0.0.1:52954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2069gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2070gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2071gitlab # [ 364.195613] nixbot[3535]: INFO: ::ffff:127.0.0.1:52970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2072gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2074gitlab # [ 365.249611] nixbot[3535]: INFO: ::ffff:127.0.0.1:52974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2078gitlab # [ 366.305201] nixbot[3535]: INFO: ::ffff:127.0.0.1:52980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2079gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2080gitlab # [ 367.357151] nixbot[3535]: INFO: ::ffff:127.0.0.1:52982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2081gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2083gitlab # [ 368.411708] nixbot[3535]: INFO: ::ffff:127.0.0.1:52986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2085gitlab # [ 369.258659] sidekiq-cluster[3427]: 2026-08-16T12:37:10.142Z pid=3427 tid=yq3 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3427, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427454464}2086gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2087gitlab # [ 369.464457] nixbot[3535]: INFO: ::ffff:127.0.0.1:52988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2089gitlab # [ 369.547398] sidekiq-cluster[3427]: W, [2026-08-16T12:37:10.432459 #3427] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2090gitlab # [ 369.685487] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:10.570Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2092gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2093gitlab # [ 370.518828] nixbot[3535]: INFO: ::ffff:127.0.0.1:52996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2094gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2095gitlab # [ 371.571658] nixbot[3535]: INFO: ::ffff:127.0.0.1:43348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2096gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2097gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2098gitlab # [ 372.628683] nixbot[3535]: INFO: ::ffff:127.0.0.1:43356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2100gitlab # [ 372.676934] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:13.560Z","message":"GitLab reliable fetch activated!"}2101gitlab # [ 372.682133] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:13.561Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2103gitlab # [ 373.683746] nixbot[3535]: INFO: ::ffff:127.0.0.1:43362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2105gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2106gitlab # [ 374.738822] nixbot[3535]: INFO: ::ffff:127.0.0.1:43378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2107gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2108gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2109gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2110gitlab # [ 375.794776] nixbot[3535]: INFO: ::ffff:127.0.0.1:43384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2111gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2112gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2113gitlab # [ 376.847632] nixbot[3535]: INFO: ::ffff:127.0.0.1:43394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2114gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2115gitlab # [ 377.900797] nixbot[3535]: INFO: ::ffff:127.0.0.1:43408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2116gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2117gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2118gitlab # [ 378.955644] nixbot[3535]: INFO: ::ffff:127.0.0.1:43414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2119gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2120gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2122gitlab # [ 380.010344] nixbot[3535]: INFO: ::ffff:127.0.0.1:43422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2125gitlab # [ 381.063018] nixbot[3535]: INFO: ::ffff:127.0.0.1:41034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2126gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2127gitlab # [ 382.116383] nixbot[3535]: INFO: ::ffff:127.0.0.1:41036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2128gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2131gitlab # [ 383.170608] nixbot[3535]: INFO: ::ffff:127.0.0.1:41038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2132gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2133gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2134gitlab # [ 384.223245] nixbot[3535]: INFO: ::ffff:127.0.0.1:41046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2136gitlab # [ 385.275724] nixbot[3535]: INFO: ::ffff:127.0.0.1:41058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2137gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2138gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2139gitlab # [ 386.329933] nixbot[3535]: INFO: ::ffff:127.0.0.1:41060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2140gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2142gitlab # [ 387.383940] nixbot[3535]: INFO: ::ffff:127.0.0.1:41070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2146gitlab # [ 388.438482] nixbot[3535]: INFO: ::ffff:127.0.0.1:41076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2148gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2149gitlab # [ 389.490634] nixbot[3535]: INFO: ::ffff:127.0.0.1:41090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2150gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2151gitlab # [ 390.542512] nixbot[3535]: INFO: ::ffff:127.0.0.1:41104 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2153gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2154gitlab # [ 391.597562] nixbot[3535]: INFO: ::ffff:127.0.0.1:41628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2156gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2157gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2158gitlab # [ 392.652579] nixbot[3535]: INFO: ::ffff:127.0.0.1:41638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2159gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2160gitlab # [ 393.705177] nixbot[3535]: INFO: ::ffff:127.0.0.1:41654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2161gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2162gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2163gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2164gitlab # [ 394.760603] nixbot[3535]: INFO: ::ffff:127.0.0.1:41666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2166gitlab # [ 395.813320] nixbot[3535]: INFO: ::ffff:127.0.0.1:41670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2167gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2168gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2169gitlab # [ 396.868909] nixbot[3535]: INFO: ::ffff:127.0.0.1:41686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2171gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2172gitlab # [ 397.924513] nixbot[3535]: INFO: ::ffff:127.0.0.1:41700 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2173gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2174gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2175gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2176gitlab # [ 398.980576] nixbot[3535]: INFO: ::ffff:127.0.0.1:41716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2177gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2178gitlab # [ 400.032850] nixbot[3535]: INFO: ::ffff:127.0.0.1:41720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2179gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2180gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2181gitlab # [ 401.088958] nixbot[3535]: INFO: ::ffff:127.0.0.1:43710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2182gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2183gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2184gitlab # [ 402.144723] nixbot[3535]: INFO: ::ffff:127.0.0.1:43718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2185gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2186gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2187gitlab # [ 403.200623] nixbot[3535]: INFO: ::ffff:127.0.0.1:43726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2189gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2190gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2191gitlab # [ 404.256117] nixbot[3535]: INFO: ::ffff:127.0.0.1:43728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2192gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2193gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2194gitlab # [ 405.310390] nixbot[3535]: INFO: ::ffff:127.0.0.1:43736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2195gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2196gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2197gitlab # [ 406.365118] nixbot[3535]: INFO: ::ffff:127.0.0.1:43738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2199gitlab # [ 407.420433] nixbot[3535]: INFO: ::ffff:127.0.0.1:43746 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2200gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2201gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2202gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2203gitlab # [ 408.473415] nixbot[3535]: INFO: ::ffff:127.0.0.1:43758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2204gitlab # [ 408.534266] postgres[4056]: [4056] ERROR: relation "table_without_models" does not exist2205gitlab # [ 408.537818] postgres[4056]: [4056] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2206gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2207gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2208gitlab # [ 409.526763] nixbot[3535]: INFO: ::ffff:127.0.0.1:43770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2209gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2210gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2211gitlab # [ 410.578425] nixbot[3535]: INFO: ::ffff:127.0.0.1:43772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2212gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2213gitlab # [ 411.631804] nixbot[3535]: INFO: ::ffff:127.0.0.1:50270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2214gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2215gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2216gitlab # [ 412.687925] nixbot[3535]: INFO: ::ffff:127.0.0.1:50272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2217gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2218gitlab # [ 413.306625] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:54.191Z","message":"Booted Rails 7.2.3.1 application in production environment"}2219gitlab # [ 413.309112] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:54.194Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2220gitlab # [ 413.311238] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:54.196Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2221gitlab # [ 413.313422] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:54.198Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2222gitlab # [ 413.319898] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:54.200Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2223gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2224gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2225gitlab # [ 413.744205] nixbot[3535]: INFO: ::ffff:127.0.0.1:50276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2226gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2227gitlab # [ 414.825726] nixbot[3535]: INFO: ::ffff:127.0.0.1:50280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2228gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.08 seconds)2229gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2230gitlab # [ 415.901758] nixbot[3535]: INFO: ::ffff:127.0.0.1:50296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.08 seconds)2232gitlab # [ 415.933121] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:56.816Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b1dfbabe737316c75eb63e84","created_at":"2026-08-16T12:36:25.238Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:25.298Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b1dfbabe737316c75eb63e84: start","job_status":"start","queue_duration_s":91.518642,"scheduling_latency_s":91.518696}2233gitlab # [ 416.185141] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.069Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b1dfbabe737316c75eb63e84","created_at":"2026-08-16T12:36:25.238Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:25.298Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b1dfbabe737316c75eb63e84: done: 0.25283 sec","job_status":"done","queue_duration_s":91.518642,"scheduling_latency_s":91.518696,"redis_calls":23,"redis_duration_s":0.007814,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004127,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002129,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14383568,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.25283,"completed_at":"2026-08-16T12:37:57.069Z","load_balancing_strategy":"primary","db_duration_s":0.097963,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2234gitlab # [ 416.286400] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.072Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"876d23f94b2d5198eabf3225","created_at":"2026-08-16T12:36:25.317Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:25.325Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-876d23f94b2d5198eabf3225: start","job_status":"start","queue_duration_s":91.746668,"scheduling_latency_s":91.74681}2235gitlab # [ 416.340687] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.225Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"876d23f94b2d5198eabf3225","created_at":"2026-08-16T12:36:25.317Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:25.325Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-876d23f94b2d5198eabf3225: done: 0.153342 sec","job_status":"done","queue_duration_s":91.746668,"scheduling_latency_s":91.74681,"redis_calls":14,"redis_duration_s":0.004814,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001264,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001397,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11899488,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.153342,"completed_at":"2026-08-16T12:37:57.225Z","load_balancing_strategy":"primary","db_duration_s":0.035067,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2236gitlab # [ 416.412504] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6ed24764ba431ea3945177b6","created_at":"2026-08-16T12:36:26.117Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.130Z","job_size_bytes":5,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6ed24764ba431ea3945177b6: start","job_status":"start","queue_duration_s":91.097393,"scheduling_latency_s":91.097417}2237gitlab # [ 416.551316] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.435Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6ed24764ba431ea3945177b6","created_at":"2026-08-16T12:36:26.117Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.130Z","job_size_bytes":5,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6ed24764ba431ea3945177b6: done: 0.20849 sec","job_status":"done","queue_duration_s":91.097393,"scheduling_latency_s":91.097417,"redis_calls":12,"redis_duration_s":0.0033970000000000003,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000892,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.159463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034298,"duration_s":0.20849,"completed_at":"2026-08-16T12:37:57.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042481,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2238gitlab # [ 416.650077] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.437Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ec15f4eee52af966becc9cb7","created_at":"2026-08-16T12:36:26.186Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.196Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ec15f4eee52af966becc9cb7: start","job_status":"start","queue_duration_s":91.241675,"scheduling_latency_s":91.241694}2239gitlab # [ 416.808897] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.693Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ec15f4eee52af966becc9cb7","created_at":"2026-08-16T12:36:26.186Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.196Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ec15f4eee52af966becc9cb7: done: 0.255779 sec","job_status":"done","queue_duration_s":91.241675,"scheduling_latency_s":91.241694,"redis_calls":11,"redis_duration_s":0.003172,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000752,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.215,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.215,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.156715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054154,"duration_s":0.255779,"completed_at":"2026-08-16T12:37:57.693Z","load_balancing_strategy":"primary","db_duration_s":0.101648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2241gitlab # [ 416.906127] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.695Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b8b5f6a56b9221ba09dee543","created_at":"2026-08-16T12:36:26.203Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.212Z","job_size_bytes":89,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b8b5f6a56b9221ba09dee543: start","job_status":"start","queue_duration_s":91.482785,"scheduling_latency_s":91.482806}2242gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.04 seconds)2243gitlab # [ 416.926409] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.741Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b8b5f6a56b9221ba09dee543","created_at":"2026-08-16T12:36:26.203Z","trace_propagation_headers":{"sentry-trace":"f744a29cb9ab4ce789c7bdee6921550a-65e2076b796b4f8f","baggage":"sentry-trace_id=f744a29cb9ab4ce789c7bdee6921550a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595ERNFNNVMHHXRSEFT9VX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:26.212Z","job_size_bytes":89,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b8b5f6a56b9221ba09dee543: done: 0.045665 sec","job_status":"done","queue_duration_s":91.482785,"scheduling_latency_s":91.482806,"redis_calls":11,"redis_duration_s":0.003173,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000849,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050518,"duration_s":0.045665,"completed_at":"2026-08-16T12:37:57.741Z","load_balancing_strategy":"primary","db_duration_s":0.008505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 416.978517] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.743Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c447fe13d60a1bf567684641170d926aad416701 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3364a46d0bbe841fb29d8657","created_at":"2026-08-16T12:36:30.685Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-37f6dc44780f461c","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:30.694Z","job_size_bytes":185,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3364a46d0bbe841fb29d8657: start","job_status":"start","queue_duration_s":87.048267,"scheduling_latency_s":87.048288}2245gitlab # [ 416.997508] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:57.761Z","message":"changes: \"0000000000000000000000000000000000000000 c447fe13d60a1bf567684641170d926aad416701 refs/heads/master\\n\""}2246gitlab # [ 417.000546] nixbot[3535]: INFO: ::ffff:127.0.0.1:50312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2247gitlab # [ 417.002823] gitaly[888]: time="2026-08-16T12:37:57.803Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:07.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:57.793" grpc.time_ms=9.969 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 417.016470] gitaly[888]: time="2026-08-16T12:37:57.830Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=6 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:38:07.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:57.808" grpc.time_ms=21.155 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 417.029922] gitaly[888]: time="2026-08-16T12:37:57.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T12:38:07.091" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:57.881" grpc.time_ms=19.368 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2250gitlab # [ 417.084669] gitaly[888]: time="2026-08-16T12:37:57.969Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:37:57.969" grpc.time_ms=0.63 pid=888 span.kind=server system=grpc2251gitlab # [ 417.118772] gitaly[888]: time="2026-08-16T12:37:58.003Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:37:58.003" grpc.time_ms=0.891 pid=888 span.kind=server system=grpc2252gitlab # [ 417.142967] gitaly[888]: time="2026-08-16T12:37:58.015Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP diskcache=1c46c812-2330-420f-9233-d1d3d826a37f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:38:07.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:57.913" pid=888 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2253gitlab # [ 417.164619] gitaly[888]: time="2026-08-16T12:37:58.016Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=106 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4917 command.oublock=8 command.real_time_ms=95 command.spawn_token_fork_ms=1 command.system_time_ms=82 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:38:07.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:57.913" grpc.time_ms=102.06 pid=888 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2254gitlab # [ 417.188523] gitaly[888]: time="2026-08-16T12:37:58.032Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T12:38:08.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:58.032" grpc.time_ms=0.273 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 417.205338] gitaly[888]: time="2026-08-16T12:37:58.059Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T12:38:08.006" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:58.037" grpc.time_ms=21.474 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 417.299388] gitaly[888]: time="2026-08-16T12:37:58.184Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T12:38:28.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:37:58.172" grpc.time_ms=11.799 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 417.344707] gitaly[888]: time="2026-08-16T12:37:58.229Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T12:38:08.198" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:58.229" grpc.time_ms=0.606 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 417.367755] gitaly[888]: time="2026-08-16T12:37:58.242Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T12:38:08.203" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T12:37:58.234" grpc.time_ms=8.039 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 417.400901] gitaly[888]: time="2026-08-16T12:37:58.286Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:08.239" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:58.269" grpc.time_ms=15.837 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 417.430233] gitaly[888]: time="2026-08-16T12:37:58.314Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:08.266" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:58.296" grpc.time_ms=17.112 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 417.481066] gitaly[888]: time="2026-08-16T12:37:58.366Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T12:38:28.237" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:37:58.337" grpc.time_ms=28.267 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2263gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2264gitlab # [ 418.012407] nixbot[3535]: INFO: ::ffff:127.0.0.1:50314 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2265gitlab # [ 418.087607] gitaly[888]: time="2026-08-16T12:37:58.971Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T12:38:08.177" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:37:58.968" grpc.time_ms=3.132 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 418.160915] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.043Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c447fe13d60a1bf567684641170d926aad416701 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3364a46d0bbe841fb29d8657","created_at":"2026-08-16T12:36:30.685Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-37f6dc44780f461c","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:30.694Z","job_size_bytes":185,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3364a46d0bbe841fb29d8657: done: 1.300573 sec","job_status":"done","queue_duration_s":87.048267,"scheduling_latency_s":87.048288,"gitaly_calls":13,"gitaly_duration_s":0.310781,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.055454,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.005403,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008205,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001972,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004919,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.020475,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01448,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.303,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.342,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.086,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.841493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007313,"exclusive_lock_hold_duration_s":0.0312231,"duration_s":1.300573,"completed_at":"2026-08-16T12:37:59.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.150018,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2267gitlab # [ 418.266260] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.047Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c447fe13d60a1bf567684641170d926aad416701 af316e3e5861a347607e4be841fa74f44ba6ab6b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5d3c045713b718461d072601","created_at":"2026-08-16T12:36:35.346Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-026aeda7b1b14b35","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:35.348Z","job_size_bytes":185,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5d3c045713b718461d072601: start","job_status":"start","queue_duration_s":83.698892,"scheduling_latency_s":83.69893}2268gitlab # [ 418.286323] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.070Z","message":"changes: \"c447fe13d60a1bf567684641170d926aad416701 af316e3e5861a347607e4be841fa74f44ba6ab6b refs/heads/master\\n\""}2269gitlab # [ 418.288908] gitaly[888]: time="2026-08-16T12:37:59.121Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:09.072" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:59.103" grpc.time_ms=17.783 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 418.302489] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.152Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"fb4672c55d5bfc6a8f5ca134","created_at":"2026-08-16T12:37:59.149Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"813eed54b80f66d1093aaa75","job_size_bytes":46,"pid":3427,"job_status":"deduplicated","message":"ProjectCacheWorker JID-fb4672c55d5bfc6a8f5ca134: deduplicated: until executing","deduplication.type":"until executing"}2271gitlab # [ 418.317417] gitaly[888]: time="2026-08-16T12:37:59.145Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T12:38:09.098" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:37:59.129" grpc.time_ms=15.796 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 418.330730] gitaly[888]: time="2026-08-16T12:37:59.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T12:38:09.141" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:59.172" grpc.time_ms=17.292 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 418.344348] gitaly[888]: time="2026-08-16T12:37:59.215Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T12:38:29.095" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:37:59.195" grpc.time_ms=19.389 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 418.362323] gitaly[888]: time="2026-08-16T12:37:59.247Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T12:38:09.205" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T12:37:59.236" grpc.time_ms=11.21 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 418.397847] gitaly[888]: time="2026-08-16T12:37:59.276Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:09.234" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:37:59.265" grpc.time_ms=11.212 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab # [ 418.527792] gitaly[888]: time="2026-08-16T12:37:59.412Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T12:38:09.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:37:59.410" grpc.time_ms=2.41 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 418.574729] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.458Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c447fe13d60a1bf567684641170d926aad416701 af316e3e5861a347607e4be841fa74f44ba6ab6b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5d3c045713b718461d072601","created_at":"2026-08-16T12:36:35.346Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-026aeda7b1b14b35","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T12:36:35.348Z","job_size_bytes":185,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5d3c045713b718461d072601: done: 0.411658 sec","job_status":"done","queue_duration_s":83.698892,"scheduling_latency_s":83.69893,"gitaly_calls":7,"gitaly_duration_s":0.122533,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032396,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003342,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001242,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004647,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010727,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012438,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.036,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.036,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.24353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00137932,"exclusive_lock_hold_duration_s":0.03390782,"duration_s":0.411658,"completed_at":"2026-08-16T12:37:59.458Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039847,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab # [ 418.662489] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.462Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"97f19cead9972da2fac40cf9","created_at":"2026-08-16T12:36:36.301Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.313Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-97f19cead9972da2fac40cf9: start","job_status":"start","queue_duration_s":83.148552,"scheduling_latency_s":83.148596}2279gitlab # [ 418.770579] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.654Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"97f19cead9972da2fac40cf9","created_at":"2026-08-16T12:36:36.301Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.313Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-97f19cead9972da2fac40cf9: done: 0.192627 sec","job_status":"done","queue_duration_s":83.148552,"scheduling_latency_s":83.148596,"redis_calls":16,"redis_duration_s":0.006586,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00334,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000928,"duration_s":0.192627,"completed_at":"2026-08-16T12:37:59.654Z","load_balancing_strategy":"primary","db_duration_s":0.039786,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2280gitlab # [ 418.878946] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.657Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9ffa3ed892ee318b43300726","created_at":"2026-08-16T12:36:36.316Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.325Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9ffa3ed892ee318b43300726: start","job_status":"start","queue_duration_s":83.331823,"scheduling_latency_s":83.331863}2281gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2282gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.07 seconds)2283gitlab # [ 419.079998] nixbot[3535]: INFO: ::ffff:127.0.0.1:50318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2284gitlab # [ 419.095316] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.979Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9ffa3ed892ee318b43300726","created_at":"2026-08-16T12:36:36.316Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.325Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9ffa3ed892ee318b43300726: done: 0.321558 sec","job_status":"done","queue_duration_s":83.331823,"scheduling_latency_s":83.331863,"redis_calls":21,"redis_duration_s":0.007956000000000001,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003922,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.256728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052684,"duration_s":0.321558,"completed_at":"2026-08-16T12:37:59.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 419.187821] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:37:59.982Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"049d2d0dece0d5588831d6bb","created_at":"2026-08-16T12:36:36.487Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.495Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-049d2d0dece0d5588831d6bb: start","job_status":"start","queue_duration_s":83.486756,"scheduling_latency_s":83.486777}2286gitlab # [ 419.435889] gitaly[888]: time="2026-08-16T12:38:00.319Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:00.317" grpc.time_ms=1.396 pid=888 span.kind=server system=grpc2287gitlab # [ 419.490995] gitaly[888]: time="2026-08-16T12:38:00.375Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:00.375" grpc.time_ms=0.717 pid=888 span.kind=server system=grpc2288gitlab # [ 419.545506] gitaly[888]: time="2026-08-16T12:38:00.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:00.428" grpc.time_ms=1.834 pid=888 span.kind=server system=grpc2289gitlab # [ 419.571730] gitaly[888]: time="2026-08-16T12:38:00.444Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB diskcache=dfdd06f7-bb44-417e-b296-153ee64582a8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:30.159" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:00.260" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 419.592908] gitaly[888]: time="2026-08-16T12:38:00.445Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=207 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7430 command.oublock=0 command.real_time_ms=177 command.spawn_token_fork_ms=1 command.system_time_ms=79 command.user_time_ms=128 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:30.159" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:00.260" grpc.time_ms=184.698 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 419.777275] gitaly[888]: time="2026-08-16T12:38:00.662Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:30.560" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:00.660" grpc.time_ms=1.527 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 419.837904] gitaly[888]: time="2026-08-16T12:38:00.723Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595TT51QNZ070SBQYXAYMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:30.620" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:00.721" grpc.time_ms=1.183 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 419.874650] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:00.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"049d2d0dece0d5588831d6bb","created_at":"2026-08-16T12:36:36.487Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-a1983347913e4d32","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:36:36.495Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-049d2d0dece0d5588831d6bb: done: 0.77083 sec","job_status":"done","queue_duration_s":83.486756,"scheduling_latency_s":83.486777,"gitaly_calls":3,"gitaly_duration_s":0.200568,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.04103,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002168,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001886,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014697,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005962,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008053,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00168,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000943,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003473,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.099,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.044,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.05,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.442405,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.67018106,"duration_s":0.77083,"completed_at":"2026-08-16T12:38:00.752Z","load_balancing_strategy":"primary","db_duration_s":0.118679,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2294gitlab # [ 419.952713] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:00.755Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"813eed54b80f66d1093aaa75","created_at":"2026-08-16T12:37:57.833Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:57.851Z","job_size_bytes":46,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-813eed54b80f66d1093aaa75: start","job_status":"start","queue_duration_s":2.903382,"scheduling_latency_s":2.903407}2295gitlab # [ 419.968437] gitaly[888]: time="2026-08-16T12:38:00.830Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T18:38:00.819" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:38:00.820" grpc.time_ms=10.097 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 419.979060] gitaly[888]: time="2026-08-16T12:38:00.860Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T12:38:30.740" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:00.841" grpc.time_ms=18.43 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2298gitlab # [ 420.034107] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:00.918Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"813eed54b80f66d1093aaa75","created_at":"2026-08-16T12:37:57.833Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:57.851Z","job_size_bytes":46,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-813eed54b80f66d1093aaa75: done: 0.163095 sec","job_status":"done","queue_duration_s":2.903382,"scheduling_latency_s":2.903407,"gitaly_calls":2,"gitaly_duration_s":0.03519,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011441999999999999,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002945,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001045,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003675,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063906,"duration_s":0.163095,"completed_at":"2026-08-16T12:38:00.918Z","load_balancing_strategy":"primary","db_duration_s":0.018995,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2299gitlab # [ 420.125996] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:00.921Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0c50e9500f645274060cc9c1","created_at":"2026-08-16T12:37:57.871Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:57.877Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0c50e9500f645274060cc9c1: start","job_status":"start","queue_duration_s":3.043996,"scheduling_latency_s":3.044032}2300gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.07 seconds)2301gitlab # [ 420.150444] gitaly[888]: time="2026-08-16T12:38:01.012Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP diskcache=5faa7143-6692-484a-b785-81f868e933de grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T18:38:00.966" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:00.967" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 420.164599] nixbot[3535]: INFO: ::ffff:127.0.0.1:50320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2303gitlab # [ 420.167218] gitaly[888]: time="2026-08-16T12:38:01.013Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=59 command.spawn_token_fork_ms=7 command.system_time_ms=22 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T18:38:00.966" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:00.967" grpc.time_ms=45.201 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2304gitlab # [ 420.215425] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:01.099Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0c50e9500f645274060cc9c1","created_at":"2026-08-16T12:37:57.871Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:57.877Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0c50e9500f645274060cc9c1: done: 0.178218 sec","job_status":"done","queue_duration_s":3.043996,"scheduling_latency_s":3.044032,"gitaly_calls":1,"gitaly_duration_s":0.050022,"redis_calls":15,"redis_duration_s":0.0064069999999999995,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000694,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001194,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.041,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1299596,"duration_s":0.178218,"completed_at":"2026-08-16T12:38:01.099Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 420.281091] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:01.102Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"be1d820ccf89c773891d5e1e","created_at":"2026-08-16T12:37:58.026Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.028Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-be1d820ccf89c773891d5e1e: start","job_status":"start","queue_duration_s":3.073542,"scheduling_latency_s":3.073575}2306gitlab # [ 420.298923] gitaly[888]: time="2026-08-16T12:38:01.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T12:38:31.051" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:01.152" grpc.time_ms=17.268 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2307gitlab # [ 420.313650] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:01.184Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"be1d820ccf89c773891d5e1e","created_at":"2026-08-16T12:37:58.026Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.028Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-be1d820ccf89c773891d5e1e: done: 0.082025 sec","job_status":"done","queue_duration_s":3.073542,"scheduling_latency_s":3.073575,"gitaly_calls":1,"gitaly_duration_s":0.020638,"redis_calls":16,"redis_duration_s":0.005636,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000418,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002444,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082025,"completed_at":"2026-08-16T12:38:01.184Z","load_balancing_strategy":"primary","db_duration_s":0.005078,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2308gitlab # [ 420.359088] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:01.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ce14ca1893c964c5d0dc3a23","created_at":"2026-08-16T12:37:58.742Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a7b5ded7ce4fa7ddc9063c303bfb86f60914bda870dd71d27a27cb6d9debd303","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.748Z","job_size_bytes":467,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ce14ca1893c964c5d0dc3a23: start","job_status":"start","queue_duration_s":2.43925,"scheduling_latency_s":2.43928}2309gitlab # [ 420.376168] gitaly[888]: time="2026-08-16T12:38:01.228Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:31.126" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:01.227" grpc.time_ms=1.015 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 420.388457] gitaly[888]: time="2026-08-16T12:38:01.243Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T12:38:11.202" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:01.233" grpc.time_ms=10.409 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 420.508952] gitaly[888]: time="2026-08-16T12:38:01.393Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:31.291" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:01.392" grpc.time_ms=1.415 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 420.522625] gitaly[888]: time="2026-08-16T12:38:01.406Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T12:38:31.301" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:01.401" grpc.time_ms=4.208 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 420.702907] gitaly[888]: time="2026-08-16T12:38:01.588Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:11.169" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:01.570" grpc.time_ms=17.603 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2315gitlab # [ 421.212121] nixbot[3535]: INFO: ::ffff:127.0.0.1:43364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2316gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.06 seconds)2317gitlab # [ 421.501549] gitaly[888]: time="2026-08-16T12:38:02.386Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T12:38:32.258" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.358" grpc.time_ms=27.994 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 421.533585] gitaly[888]: time="2026-08-16T12:38:02.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595MRJSCPEQQ0P9EBM17FP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T12:38:32.292" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.392" grpc.time_ms=25.108 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 421.600718] sidekiq-cluster[3427]: {"severity":"WARN","time":"2026-08-16T12:38:02.484Z","class":"CreatePipelineWorker","correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"c447fe13d60a1bf567684641170d926aad416701","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"c447fe13d60a1bf567684641170d926aad416701","ref":"refs/heads/master"},"retry":0}2320gitlab # [ 421.622756] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ce14ca1893c964c5d0dc3a23","created_at":"2026-08-16T12:37:58.742Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a7b5ded7ce4fa7ddc9063c303bfb86f60914bda870dd71d27a27cb6d9debd303","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.748Z","job_size_bytes":467,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ce14ca1893c964c5d0dc3a23: done: 1.31612 sec","job_status":"done","queue_duration_s":2.43925,"scheduling_latency_s":2.43928,"gitaly_calls":7,"gitaly_duration_s":0.112683,"redis_calls":51,"redis_duration_s":0.015584,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001411,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006444,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003392,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.123635,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010024,"duration_s":1.31612,"completed_at":"2026-08-16T12:38:02.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083829,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 421.714154] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.507Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f54e5d50-0cd1-4f8a-8ce4-8eba5972ab22\"}"],"class":"WebHookWorker","jid":"a9733d9650c25db06b21d753","created_at":"2026-08-16T12:37:58.897Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fbe14837313448ab1a2cd937dced883fc307db87c2a0f5997b6db7ad3c040111","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.907Z","job_size_bytes":1751,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a9733d9650c25db06b21d753: start","job_status":"start","queue_duration_s":3.60026,"scheduling_latency_s":3.600302}2322gitlab # [ 421.846481] nixbot[3535]: INFO: ::ffff:127.0.0.1:43378 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2323gitlab # [ 421.890414] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.774Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f54e5d50-0cd1-4f8a-8ce4-8eba5972ab22\"}"],"class":"WebHookWorker","jid":"a9733d9650c25db06b21d753","created_at":"2026-08-16T12:37:58.897Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-466cc0ea05174103","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fbe14837313448ab1a2cd937dced883fc307db87c2a0f5997b6db7ad3c040111","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:58.907Z","job_size_bytes":1751,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a9733d9650c25db06b21d753: done: 0.267087 sec","job_status":"done","queue_duration_s":3.60026,"scheduling_latency_s":3.600302,"redis_calls":19,"redis_duration_s":0.0071979999999999995,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001704,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000841,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003147,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08886513999999579,"cpu_s":0.149858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074952,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.267087,"completed_at":"2026-08-16T12:38:02.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab # [ 421.998116] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.778Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"740efc226026d3671b96f584","created_at":"2026-08-16T12:37:59.163Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0c50e9500f645274060cc9c1","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.166Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-740efc226026d3671b96f584: start","job_status":"start","queue_duration_s":3.612041,"scheduling_latency_s":3.612093}2325gitlab # [ 422.022140] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.877Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"740efc226026d3671b96f584","created_at":"2026-08-16T12:37:59.163Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0c50e9500f645274060cc9c1","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.166Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-740efc226026d3671b96f584: done: 0.099567 sec","job_status":"done","queue_duration_s":3.612041,"scheduling_latency_s":3.612093,"gitaly_calls":1,"gitaly_duration_s":0.019712,"redis_calls":12,"redis_duration_s":0.006013,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001315,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05379488,"duration_s":0.099567,"completed_at":"2026-08-16T12:38:02.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 422.071030] gitaly[888]: time="2026-08-16T12:38:02.842Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T diskcache=f9643e62-7bcb-4dfa-ae86-86c453d6f864 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T18:38:02.826" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.827" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab # [ 422.081557] gitaly[888]: time="2026-08-16T12:38:02.842Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T18:38:02.826" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.827" grpc.time_ms=15.126 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 422.096642] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1472329gitlab # [ 422.098797] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:02.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ac3e668514d7acb12b6575f","created_at":"2026-08-16T12:37:59.358Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:accb03ac3dd52af7a54d8012ea71c578329aee1f2b873ace2b16eb28c3c864be","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.362Z","job_size_bytes":467,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ac3e668514d7acb12b6575f: start","job_status":"start","queue_duration_s":3.518414,"scheduling_latency_s":3.51845}2330gitlab # [ 422.116514] gitaly[888]: time="2026-08-16T12:38:02.917Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:32.815" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.916" grpc.time_ms=1.079 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 422.129059] gitaly[888]: time="2026-08-16T12:38:02.936Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T12:38:12.130" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:02.921" grpc.time_ms=14.948 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 422.142113] gitaly[888]: time="2026-08-16T12:38:02.951Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0598FSM6464DREF6YZ68Z4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:02.929" grpc.time_ms=21.999 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2333gitlab # [ 422.155446] gitaly[888]: time="2026-08-16T12:38:02.989Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:32.887" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.987" grpc.time_ms=1.166 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 422.168473] gitaly[888]: time="2026-08-16T12:38:02.997Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=35 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T12:38:32.893" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:02.993" grpc.time_ms=3.763 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 422.184658] gitaly[888]: time="2026-08-16T12:38:03.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:13.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:03.032" grpc.time_ms=15.281 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2337gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.05 seconds)2338gitlab # [ 422.260387] nixbot[3535]: INFO: ::ffff:127.0.0.1:43388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2339gitlab # [ 422.269356] gitaly[888]: time="2026-08-16T12:38:03.154Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0598FYAJHEVWE1BGFE3Z8K7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:03.140" pid=888 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2340gitlab # [ 422.283233] gitaly[888]: time="2026-08-16T12:38:03.154Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0598FYAJHEVWE1BGFE3Z8K7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:03.140" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2341gitlab # [ 422.301275] gitlab-workhorse[821]: time="2026-08-16T12:38:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672342gitlab # [ 422.303467] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2002343gitlab # [ 422.305773] gitaly[888]: time="2026-08-16T12:38:03.156Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0598FYAJHEVWE1BGFE3Z8K7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:03.140" grpc.time_ms=14.862 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2344gitlab # [ 422.324039] nixbot[3535]: {"ts": "2026-08-16T12:38:03.209Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2345gitlab # [ 422.403871] gitaly[888]: time="2026-08-16T12:38:03.288Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:33.187" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:03.287" grpc.time_ms=0.846 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab # [ 422.580884] gitaly[888]: time="2026-08-16T12:38:03.465Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:13.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:03.447" grpc.time_ms=17.475 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2347gitlab # [ 422.680343] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3412348gitlab # [ 422.688851] nixbot[3535]: {"ts": "2026-08-16T12:38:03.567Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}2349gitlab # [ 422.824799] gitaly[888]: time="2026-08-16T12:38:03.709Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598GHQ814BTJNSYYJZ2HYZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:33.507" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:03.708" grpc.time_ms=1.316 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 422.847351] gitaly[888]: time="2026-08-16T12:38:03.732Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T12:38:33.605" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:03.706" grpc.time_ms=26.084 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 422.888886] gitaly[888]: time="2026-08-16T12:38:03.752Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0595T01Z9MP7240Z957ZN7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T12:38:33.635" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:03.735" grpc.time_ms=16.828 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 422.920250] sidekiq-cluster[3427]: {"severity":"WARN","time":"2026-08-16T12:38:03.775Z","class":"CreatePipelineWorker","correlation_id":"01M0595T01Z9MP7240Z957ZN7T","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"c447fe13d60a1bf567684641170d926aad416701","after":"af316e3e5861a347607e4be841fa74f44ba6ab6b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"af316e3e5861a347607e4be841fa74f44ba6ab6b","ref":"refs/heads/master"},"retry":0}2353gitlab # [ 422.933943] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.782Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ac3e668514d7acb12b6575f","created_at":"2026-08-16T12:37:59.358Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:accb03ac3dd52af7a54d8012ea71c578329aee1f2b873ace2b16eb28c3c864be","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.362Z","job_size_bytes":467,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ac3e668514d7acb12b6575f: done: 0.901561 sec","job_status":"done","queue_duration_s":3.518414,"scheduling_latency_s":3.51845,"gitaly_calls":7,"gitaly_duration_s":0.098882,"redis_calls":33,"redis_duration_s":0.00707,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000654,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003579,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.76644,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.901561,"completed_at":"2026-08-16T12:38:03.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2354gitlab # [ 423.001832] nixbot[3535]: INFO: ::ffff:127.0.0.1:43392 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2355gitlab # [ 423.003332] gitaly[888]: time="2026-08-16T12:38:03.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598GHQ814BTJNSYYJZ2HYZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:13.085" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:03.835" grpc.time_ms=19.698 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 423.017935] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.784Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1a84be2b-ef90-424a-993e-61c2c1cdca4f\"}"],"class":"WebHookWorker","jid":"1f01b541d0bf42390415e9cd","created_at":"2026-08-16T12:37:59.386Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf331053c12dcd2f5fe60c503606aa42fc9326f64485a79edee0eb58e2c7800a","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.390Z","job_size_bytes":1749,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1f01b541d0bf42390415e9cd: start","job_status":"start","queue_duration_s":4.393994,"scheduling_latency_s":4.394017}2357gitlab # [ 423.036379] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.836Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1a84be2b-ef90-424a-993e-61c2c1cdca4f\"}"],"class":"WebHookWorker","jid":"1f01b541d0bf42390415e9cd","created_at":"2026-08-16T12:37:59.386Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-65fa463f751342d6","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf331053c12dcd2f5fe60c503606aa42fc9326f64485a79edee0eb58e2c7800a","size_limiter":"validated","enqueued_at":"2026-08-16T12:37:59.390Z","job_size_bytes":1749,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1f01b541d0bf42390415e9cd: done: 0.052235 sec","job_status":"done","queue_duration_s":4.393994,"scheduling_latency_s":4.394017,"redis_calls":14,"redis_duration_s":0.0074789999999999995,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000465,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005998,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006699739999987742,"cpu_s":0.029964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.052235,"completed_at":"2026-08-16T12:38:03.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 423.084470] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"52f975b0110be004d14a3d38","created_at":"2026-08-16T12:38:00.228Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.239Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-52f975b0110be004d14a3d38: start","job_status":"start","queue_duration_s":3.60113,"scheduling_latency_s":3.601151}2359gitlab # [ 423.101217] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"52f975b0110be004d14a3d38","created_at":"2026-08-16T12:38:00.228Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.239Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-52f975b0110be004d14a3d38: done: 0.098672 sec","job_status":"done","queue_duration_s":3.60113,"scheduling_latency_s":3.601151,"redis_calls":10,"redis_duration_s":0.00159,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024046,"duration_s":0.098672,"completed_at":"2026-08-16T12:38:03.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014309,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2360gitlab # [ 423.147537] gitaly[888]: time="2026-08-16T12:38:03.945Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598GTFQ35PDQZKY2YCMVF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:03.932" grpc.time_ms=12.577 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2361gitlab # [ 423.163186] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3302362gitlab # [ 423.165941] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 912363gitlab # [ 423.168005] gitlab-workhorse[821]: time="2026-08-16T12:38:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672364gitlab # [ 423.170019] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 702365gitlab # [ 423.172354] nixbot[3535]: {"ts": "2026-08-16T12:38:03.907Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}2366gitlab # [ 423.175067] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.941Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7bc95652cdf84c19be98e911","created_at":"2026-08-16T12:38:00.455Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.468Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7bc95652cdf84c19be98e911: start","job_status":"start","queue_duration_s":3.472907,"scheduling_latency_s":3.472952}2367gitlab # [ 423.194171] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.978Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7bc95652cdf84c19be98e911","created_at":"2026-08-16T12:38:00.455Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.468Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7bc95652cdf84c19be98e911: done: 0.036904 sec","job_status":"done","queue_duration_s":3.472907,"scheduling_latency_s":3.472952,"redis_calls":10,"redis_duration_s":0.001601,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026384,"duration_s":0.036904,"completed_at":"2026-08-16T12:38:03.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2368gitlab # [ 423.239437] gitaly[888]: time="2026-08-16T12:38:03.973Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598GW90FXX26K46BZT2CE4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:33.772" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:03.972" grpc.time_ms=0.54 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 423.252844] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1612370gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2371gitlab # [ 423.255319] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:03.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b3d70ba6fe6ae569c4f6ccb7","created_at":"2026-08-16T12:38:00.501Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.513Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b3d70ba6fe6ae569c4f6ccb7: start","job_status":"start","queue_duration_s":3.466584,"scheduling_latency_s":3.466602}2372gitlab # [ 423.271097] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b3d70ba6fe6ae569c4f6ccb7","created_at":"2026-08-16T12:38:00.501Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.513Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b3d70ba6fe6ae569c4f6ccb7: done: 0.039494 sec","job_status":"done","queue_duration_s":3.466584,"scheduling_latency_s":3.466602,"redis_calls":10,"redis_duration_s":0.001556,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002489,"duration_s":0.039494,"completed_at":"2026-08-16T12:38:04.019Z","load_balancing_strategy":"primary","db_duration_s":0.005316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 423.314617] nixbot[3535]: {"ts": "2026-08-16T12:38:04.078Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c447fe13d60a1bf567684641170d926aad416701 \"HTTP/1.1 201 Created\""}2374gitlab # [ 423.318806] nix-daemon[3751]: accepted connection from pid 4298, user nixbot2375gitlab # [ 423.319781] gitaly[888]: time="2026-08-16T12:38:04.016Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0598GW90FXX26K46BZT2CE4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:14.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.004" grpc.time_ms=11.952 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2376gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.08 seconds)2377gitlab # [ 423.333533] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"574bdb6065ff206cf9bdbd74","created_at":"2026-08-16T12:38:00.546Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.556Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-574bdb6065ff206cf9bdbd74: start","job_status":"start","queue_duration_s":3.463745,"scheduling_latency_s":3.463763}2378gitlab # [ 423.349199] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.069Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"574bdb6065ff206cf9bdbd74","created_at":"2026-08-16T12:38:00.546Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.556Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-574bdb6065ff206cf9bdbd74: done: 0.049021 sec","job_status":"done","queue_duration_s":3.463745,"scheduling_latency_s":3.463763,"redis_calls":13,"redis_duration_s":0.004062,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001598,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035176,"duration_s":0.049021,"completed_at":"2026-08-16T12:38:04.069Z","load_balancing_strategy":"primary","db_duration_s":0.00999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 423.394526] gitaly[888]: time="2026-08-16T12:38:04.019Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0598GXDXSHVZR0KZB2Y2018 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.007" pid=888 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2380gitlab # [ 423.404725] nixbot[3535]: INFO: ::ffff:127.0.0.1:43404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2381gitlab # [ 423.406586] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.073Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"369972eb46c5b0fbc1e2ef4c","created_at":"2026-08-16T12:38:00.558Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.567Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-369972eb46c5b0fbc1e2ef4c: start","job_status":"start","queue_duration_s":3.506269,"scheduling_latency_s":3.506308}2382gitlab # [ 423.423272] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"369972eb46c5b0fbc1e2ef4c","created_at":"2026-08-16T12:38:00.558Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.567Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-369972eb46c5b0fbc1e2ef4c: done: 0.041987 sec","job_status":"done","queue_duration_s":3.506269,"scheduling_latency_s":3.506308,"redis_calls":10,"redis_duration_s":0.0042699999999999995,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003051,"duration_s":0.041987,"completed_at":"2026-08-16T12:38:04.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2383gitlab # [ 423.468109] gitaly[888]: time="2026-08-16T12:38:04.019Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0598GXDXSHVZR0KZB2Y2018 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.007" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2384gitlab # [ 423.481445] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2142385gitlab # [ 423.483518] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ff765cacf937ba2fcf2a5f1","created_at":"2026-08-16T12:38:00.568Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.579Z","job_size_bytes":19,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ff765cacf937ba2fcf2a5f1: start","job_status":"start","queue_duration_s":3.539691,"scheduling_latency_s":3.539716}2386gitlab # [ 423.500106] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ff765cacf937ba2fcf2a5f1","created_at":"2026-08-16T12:38:00.568Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.579Z","job_size_bytes":19,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ff765cacf937ba2fcf2a5f1: done: 0.033885 sec","job_status":"done","queue_duration_s":3.539691,"scheduling_latency_s":3.539716,"redis_calls":11,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062672,"duration_s":0.033885,"completed_at":"2026-08-16T12:38:04.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 423.546466] gitaly[888]: time="2026-08-16T12:38:04.019Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0598GXDXSHVZR0KZB2Y2018 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.007" grpc.time_ms=11.611 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2388gitlab # [ 423.561085] gitlab-workhorse[821]: time="2026-08-16T12:38:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672389gitlab # [ 423.562857] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722390gitlab # [ 423.564765] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.154Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dc8907ee1a43f264a6cab938","created_at":"2026-08-16T12:38:00.585Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.592Z","job_size_bytes":66,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dc8907ee1a43f264a6cab938: start","job_status":"start","queue_duration_s":3.562163,"scheduling_latency_s":3.562182}2391gitlab # [ 423.582046] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.188Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dc8907ee1a43f264a6cab938","created_at":"2026-08-16T12:38:00.585Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.592Z","job_size_bytes":66,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dc8907ee1a43f264a6cab938: done: 0.033895 sec","job_status":"done","queue_duration_s":3.562163,"scheduling_latency_s":3.562182,"redis_calls":10,"redis_duration_s":0.001514,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028414,"duration_s":0.033895,"completed_at":"2026-08-16T12:38:04.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 423.627824] gitaly[888]: time="2026-08-16T12:38:04.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598H1FN5WGT34YF9EB39AB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.278" grpc.time_ms=12.921 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2393gitlab # [ 423.641238] gitaly[888]: time="2026-08-16T12:38:04.365Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0598H86TX7DWS0TEEV1XWTY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.349" pid=888 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2394gitlab # [ 423.651446] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532395gitlab # [ 423.653638] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f2679aebe345f90c37b1b43a","created_at":"2026-08-16T12:38:00.593Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.601Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f2679aebe345f90c37b1b43a: start","job_status":"start","queue_duration_s":3.588242,"scheduling_latency_s":3.588261}2396gitlab # [ 423.669707] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.233Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f2679aebe345f90c37b1b43a","created_at":"2026-08-16T12:38:00.593Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.601Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f2679aebe345f90c37b1b43a: done: 0.043554 sec","job_status":"done","queue_duration_s":3.588242,"scheduling_latency_s":3.588261,"redis_calls":10,"redis_duration_s":0.0013959999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023524,"duration_s":0.043554,"completed_at":"2026-08-16T12:38:04.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 423.714802] gitaly[888]: time="2026-08-16T12:38:04.365Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598H86TX7DWS0TEEV1XWTY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.349" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2398gitlab # [ 423.728510] gitlab-workhorse[821]: time="2026-08-16T12:38:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162399gitlab # [ 423.730335] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 842400gitlab # [ 423.732228] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.235Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9666d367cdde73bad05aadff","created_at":"2026-08-16T12:38:00.611Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.616Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9666d367cdde73bad05aadff: start","job_status":"start","queue_duration_s":3.618586,"scheduling_latency_s":3.618607}2401gitlab # [ 423.749559] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.271Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9666d367cdde73bad05aadff","created_at":"2026-08-16T12:38:00.611Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.616Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9666d367cdde73bad05aadff: done: 0.036248 sec","job_status":"done","queue_duration_s":3.618586,"scheduling_latency_s":3.618607,"redis_calls":10,"redis_duration_s":0.001451,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002194,"duration_s":0.036248,"completed_at":"2026-08-16T12:38:04.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 423.793724] gitaly[888]: time="2026-08-16T12:38:04.366Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598H86TX7DWS0TEEV1XWTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.349" grpc.time_ms=16.962 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2403gitlab # [ 423.808375] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.273Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2bc71cb8216719186643c001","created_at":"2026-08-16T12:38:00.617Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.622Z","job_size_bytes":6,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2bc71cb8216719186643c001: start","job_status":"start","queue_duration_s":3.650504,"scheduling_latency_s":3.650522}2404gitlab # [ 423.824360] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.301Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2bc71cb8216719186643c001","created_at":"2026-08-16T12:38:00.617Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.622Z","job_size_bytes":6,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2bc71cb8216719186643c001: done: 0.028435 sec","job_status":"done","queue_duration_s":3.650504,"scheduling_latency_s":3.650522,"redis_calls":10,"redis_duration_s":0.004709,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000986,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101942,"duration_s":0.028435,"completed_at":"2026-08-16T12:38:04.301Z","load_balancing_strategy":"primary","db_duration_s":0.002756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 423.868356] gitaly[888]: time="2026-08-16T12:38:04.479Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0598HCAWAJVM8RG12Z67EVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.470" grpc.time_ms=9.585 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2406gitlab # [ 423.881460] gitaly[888]: time="2026-08-16T12:38:04.565Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0598HE2Z43VFQ3EXS3Q3ANE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.540" pid=888 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2407gitlab # [ 423.891614] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9e22e8bcbdbbb3848d01b545","created_at":"2026-08-16T12:38:00.623Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.629Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9e22e8bcbdbbb3848d01b545: start","job_status":"start","queue_duration_s":3.673878,"scheduling_latency_s":3.673896}2408gitlab # [ 423.907268] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.341Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9e22e8bcbdbbb3848d01b545","created_at":"2026-08-16T12:38:00.623Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.629Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9e22e8bcbdbbb3848d01b545: done: 0.038328 sec","job_status":"done","queue_duration_s":3.673878,"scheduling_latency_s":3.673896,"redis_calls":10,"redis_duration_s":0.001425,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023992,"duration_s":0.038328,"completed_at":"2026-08-16T12:38:04.341Z","load_balancing_strategy":"primary","db_duration_s":0.006989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 423.952175] gitaly[888]: time="2026-08-16T12:38:04.566Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HE2Z43VFQ3EXS3Q3ANE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.540" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2410gitlab # [ 423.966010] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.342Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4b2f7da0355431704eaa4cee","created_at":"2026-08-16T12:38:00.637Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.643Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4b2f7da0355431704eaa4cee: start","job_status":"start","queue_duration_s":3.699255,"scheduling_latency_s":3.699274}2411gitlab # [ 423.982293] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.410Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"4b2f7da0355431704eaa4cee","created_at":"2026-08-16T12:38:00.637Z","trace_propagation_headers":{"sentry-trace":"24baf9c101b64e4d90389b50a42fbce1-6da61ec6804f47a6","baggage":"sentry-trace_id=24baf9c101b64e4d90389b50a42fbce1,sentry-release=Unknown"},"correlation_id":"01M0595TT51QNZ070SBQYXAYMB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.643Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-4b2f7da0355431704eaa4cee: done: 0.067844 sec","job_status":"done","queue_duration_s":3.699255,"scheduling_latency_s":3.699274,"redis_calls":14,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023616,"duration_s":0.067844,"completed_at":"2026-08-16T12:38:04.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2412gitlab # [ 424.028939] gitaly[888]: time="2026-08-16T12:38:04.566Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HE2Z43VFQ3EXS3Q3ANE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:04.540" grpc.time_ms=25.797 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2413gitlab # [ 424.044164] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"740349181533da229cd991c2","created_at":"2026-08-16T12:38:00.878Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-3119ac100428452f","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.889Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-740349181533da229cd991c2: start","job_status":"start","queue_duration_s":3.522299,"scheduling_latency_s":3.52232}2414gitlab # [ 424.060273] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"740349181533da229cd991c2","created_at":"2026-08-16T12:38:00.878Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-3119ac100428452f","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:00.889Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-740349181533da229cd991c2: done: 0.097712 sec","job_status":"done","queue_duration_s":3.522299,"scheduling_latency_s":3.52232,"redis_calls":19,"redis_duration_s":0.007325,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000828,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001455,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002939,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002103,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02077144,"duration_s":0.097712,"completed_at":"2026-08-16T12:38:04.509Z","load_balancing_strategy":"primary","db_duration_s":0.010067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 424.105516] gitaly[888]: time="2026-08-16T12:38:04.685Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:34.584" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:04.684" grpc.time_ms=0.868 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab # [ 424.118511] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.513Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a9733d9650c25db06b21d753"],"class":"WebHooks::LogExecutionWorker","jid":"616bd0723a0aa5ae844d0e11","created_at":"2026-08-16T12:38:02.738Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-1906bf5ded33488e","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c947225ef1050bcf732df1093ea012f53322c805b0d1ecd58de692b977945743","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:02.752Z","job_size_bytes":2593,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-616bd0723a0aa5ae844d0e11: start","job_status":"start","queue_duration_s":1.760083,"scheduling_latency_s":1.760116}2417gitlab # [ 424.135644] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.599Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a9733d9650c25db06b21d753"],"class":"WebHooks::LogExecutionWorker","jid":"616bd0723a0aa5ae844d0e11","created_at":"2026-08-16T12:38:02.738Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-1906bf5ded33488e","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c947225ef1050bcf732df1093ea012f53322c805b0d1ecd58de692b977945743","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:02.752Z","job_size_bytes":2593,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-616bd0723a0aa5ae844d0e11: done: 0.086983 sec","job_status":"done","queue_duration_s":1.760083,"scheduling_latency_s":1.760116,"redis_calls":10,"redis_duration_s":0.005314,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002087,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037626,"duration_s":0.086983,"completed_at":"2026-08-16T12:38:04.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 424.182123] nixbot[3535]: {"ts": "2026-08-16T12:38:04.995Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b \"HTTP/1.1 201 Created\""}2419gitlab # [ 424.184910] nixbot[3535]: {"ts": "2026-08-16T12:38:05.007Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-af316e3e5861-4"}2420gitlab # [ 424.187163] gitaly[888]: time="2026-08-16T12:38:04.711Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T12:38:34.598" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.699" grpc.time_ms=12.221 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2421gitlab # [ 424.201509] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3782422gitlab # [ 424.204061] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:04.602Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17aee4c0e85b52815ec8a7aa","created_at":"2026-08-16T12:38:03.537Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-ec315ef1b6aa4f50","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:03.543Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-17aee4c0e85b52815ec8a7aa: start","job_status":"start","queue_duration_s":1.058527,"scheduling_latency_s":1.058551}2423gitlab # [ 424.220057] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.009Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17aee4c0e85b52815ec8a7aa","created_at":"2026-08-16T12:38:03.537Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-ec315ef1b6aa4f50","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:03.543Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3427,"job_status":"rescheduled","message":"PipelineProcessWorker JID-17aee4c0e85b52815ec8a7aa: rescheduled"}2424gitlab # [ 424.234825] gitaly[888]: time="2026-08-16T12:38:04.735Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:14.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.720" grpc.time_ms=14.96 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2425gitlab # [ 424.248588] nix-daemon[3751]: accepted connection from pid 4387, user nixbot2426gitlab # [ 424.249569] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17aee4c0e85b52815ec8a7aa","created_at":"2026-08-16T12:38:03.537Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-ec315ef1b6aa4f50","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:03.543Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-17aee4c0e85b52815ec8a7aa: done: 0.415563 sec","job_status":"done","queue_duration_s":1.058527,"scheduling_latency_s":1.058551,"gitaly_calls":3,"gitaly_duration_s":0.150104,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018272,"redis_read_bytes":150,"redis_write_bytes":18017,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001405,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001342,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.005118,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12316,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005511,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00052,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000564,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002407,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203481,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3514765,"duration_s":0.415563,"completed_at":"2026-08-16T12:38:05.017Z","load_balancing_strategy":"primary","db_duration_s":0.056759,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2427gitlab # [ 424.301289] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.019Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1f01b541d0bf42390415e9cd"],"class":"WebHooks::LogExecutionWorker","jid":"6fc6d60d3f5ed88cff9be98c","created_at":"2026-08-16T12:38:03.818Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-4c502787cfa54277","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e85f06717e99584f580a2d9c55771d45a2898dd152f9b14402537ef9cc3444b3","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:03.826Z","job_size_bytes":2591,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6fc6d60d3f5ed88cff9be98c: start","job_status":"start","queue_duration_s":1.193341,"scheduling_latency_s":1.193366}2428gitlab # [ 424.318303] gitaly[888]: time="2026-08-16T12:38:04.762Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T12:38:14.032" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:38:04.762" grpc.time_ms=0.308 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2429gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b'2430gitlab # [ 424.329067] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.051Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1f01b541d0bf42390415e9cd"],"class":"WebHooks::LogExecutionWorker","jid":"6fc6d60d3f5ed88cff9be98c","created_at":"2026-08-16T12:38:03.818Z","trace_propagation_headers":{"sentry-trace":"1aecdc624ad24a2b9c12ec8afb01ed77-4c502787cfa54277","baggage":"sentry-trace_id=1aecdc624ad24a2b9c12ec8afb01ed77,sentry-release=Unknown"},"correlation_id":"01M0595T01Z9MP7240Z957ZN7T","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e85f06717e99584f580a2d9c55771d45a2898dd152f9b14402537ef9cc3444b3","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:03.826Z","job_size_bytes":2591,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6fc6d60d3f5ed88cff9be98c: done: 0.031776 sec","job_status":"done","queue_duration_s":1.193341,"scheduling_latency_s":1.193366,"redis_calls":7,"redis_duration_s":0.001546,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031776,"completed_at":"2026-08-16T12:38:05.051Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 424.370614] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.053Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2ac0afe2ac3115dd1ff7ad38","created_at":"2026-08-16T12:38:04.472Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-aae010e4ab59475f","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.484Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2ac0afe2ac3115dd1ff7ad38: start","job_status":"start","queue_duration_s":0.568609,"scheduling_latency_s":0.56863}2432gitlab # [ 424.387436] gitaly[888]: time="2026-08-16T12:38:04.779Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T12:38:14.038" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.768" grpc.time_ms=11.047 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 424.401366] gitaly[888]: time="2026-08-16T12:38:04.787Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:04.786" grpc.time_ms=0.678 pid=888 span.kind=server system=grpc2434gitlab # [ 424.411449] nix-daemon[3751]: accepted connection from pid 4395, user nixbot2435gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b', in 0.11 seconds)2436gitlab # [ 424.412499] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2ac0afe2ac3115dd1ff7ad38","created_at":"2026-08-16T12:38:04.472Z","trace_propagation_headers":{"sentry-trace":"b496283587ce45d781538d82a8508703-aae010e4ab59475f","baggage":"sentry-trace_id=b496283587ce45d781538d82a8508703,sentry-release=Unknown"},"correlation_id":"01M0595MRJSCPEQQ0P9EBM17FP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.484Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2ac0afe2ac3115dd1ff7ad38: done: 0.093719 sec","job_status":"done","queue_duration_s":0.568609,"scheduling_latency_s":0.56863,"redis_calls":11,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001827,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000356,"duration_s":0.093719,"completed_at":"2026-08-16T12:38:05.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437(finished: subtest: push delivers the webhook, in 90.77 seconds)2438subtest: eval and build post commit statuses2439gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2440gitlab # [ 424.457814] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"aa5b142d760bed13ba787e91","created_at":"2026-08-16T12:38:04.717Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.721Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-aa5b142d760bed13ba787e91: start","job_status":"start","queue_duration_s":0.427238,"scheduling_latency_s":0.427257}2441gitlab # [ 424.475210] gitaly[888]: time="2026-08-16T12:38:04.831Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:04.830" grpc.time_ms=0.499 pid=888 span.kind=server system=grpc2442gitlab # [ 424.485438] gitaly[888]: time="2026-08-16T12:38:04.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:04.830" grpc.time_ms=0.583 pid=888 span.kind=server system=grpc2443gitlab # [ 424.495734] nixbot[3535]: {"ts": "2026-08-16T12:38:05.280Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-af316e3e5861-4", "argv0": "bwrap"}2444gitlab # [ 424.498290] nixbot[3535]: INFO: ::ffff:127.0.0.1:43416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 200 OK2445gitlab # [ 424.500252] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.193Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"aa5b142d760bed13ba787e91","created_at":"2026-08-16T12:38:04.717Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.721Z","job_size_bytes":23,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-aa5b142d760bed13ba787e91: done: 0.044645 sec","job_status":"done","queue_duration_s":0.427238,"scheduling_latency_s":0.427257,"redis_calls":7,"redis_duration_s":0.001093,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044645,"completed_at":"2026-08-16T12:38:05.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008597,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2446gitlab # [ 424.542872] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.194Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"684d76253d9f6a5e45009096","created_at":"2026-08-16T12:38:04.879Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.884Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-684d76253d9f6a5e45009096: start","job_status":"start","queue_duration_s":0.30988,"scheduling_latency_s":0.3099}2447gitlab # [ 424.559643] gitaly[888]: time="2026-08-16T12:38:04.863Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:04.862" grpc.time_ms=0.399 pid=888 span.kind=server system=grpc2448gitlab # [ 424.569512] gitaly[888]: time="2026-08-16T12:38:04.867Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:04.867" grpc.time_ms=0.384 pid=888 span.kind=server system=grpc2449gitlab # [ 424.579289] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.225Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"684d76253d9f6a5e45009096","created_at":"2026-08-16T12:38:04.879Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.884Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-684d76253d9f6a5e45009096: done: 0.030791 sec","job_status":"done","queue_duration_s":0.30988,"scheduling_latency_s":0.3099,"redis_calls":7,"redis_duration_s":0.001115,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030791,"completed_at":"2026-08-16T12:38:05.225Z","load_balancing_strategy":"primary","db_duration_s":0.005194,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2450gitlab # [ 424.624090] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.226Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d152323a322047aa8c9a95d1","created_at":"2026-08-16T12:38:04.882Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.886Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d152323a322047aa8c9a95d1: start","job_status":"start","queue_duration_s":0.340098,"scheduling_latency_s":0.340118}2451gitlab # [ 424.641078] gitaly[888]: time="2026-08-16T12:38:04.874Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK diskcache=0b0b9bd8-a882-40fa-b8e1-8a69c94bac57 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:38:14.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:38:04.783" pid=888 ref=refs/keep-around/af316e3e5861a347607e4be841fa74f44ba6ab6b remote_ip="2001:db8:1::1" revision=af316e3e5861a347607e4be841fa74f44ba6ab6b span.kind=server system=grpc username=root2452gitlab # [ 424.652868] nix-daemon[3751]: accepted connection from pid 4410, user nixbot2453gitlab # [ 424.653813] nix-daemon[3751]: accepted connection from pid 4424, user nixbot2454gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.20 seconds)2455gitlab # [ 424.654677] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.257Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d152323a322047aa8c9a95d1","created_at":"2026-08-16T12:38:04.882Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.886Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d152323a322047aa8c9a95d1: done: 0.030806 sec","job_status":"done","queue_duration_s":0.340098,"scheduling_latency_s":0.340118,"redis_calls":7,"redis_duration_s":0.000983,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030806,"completed_at":"2026-08-16T12:38:05.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 424.697970] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.258Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"08ee475e9c6bcb3b88c503df","created_at":"2026-08-16T12:38:04.885Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.888Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-08ee475e9c6bcb3b88c503df: start","job_status":"start","queue_duration_s":0.370058,"scheduling_latency_s":0.370079}2457gitlab # [ 424.715652] gitaly[888]: time="2026-08-16T12:38:04.874Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5030 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=6 command.system_time_ms=31 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T12:38:14.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T12:38:04.783" grpc.time_ms=90.934 pid=888 ref=refs/keep-around/af316e3e5861a347607e4be841fa74f44ba6ab6b remote_ip="2001:db8:1::1" revision=af316e3e5861a347607e4be841fa74f44ba6ab6b span.kind=server system=grpc username=root2458gitlab # [ 424.730606] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1362459gitlab # [ 424.733284] nix-daemon[3751]: accepted connection from pid 4410, user nixbot2460gitlab # [ 424.734199] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.355Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"08ee475e9c6bcb3b88c503df","created_at":"2026-08-16T12:38:04.885Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.888Z","job_size_bytes":65,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-08ee475e9c6bcb3b88c503df: done: 0.097022 sec","job_status":"done","queue_duration_s":0.370058,"scheduling_latency_s":0.370079,"redis_calls":10,"redis_duration_s":0.002126,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.097022,"completed_at":"2026-08-16T12:38:05.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2461gitlab # [ 424.777648] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ed3116dc81eb4dfce66eaa05","created_at":"2026-08-16T12:38:04.896Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.899Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ed3116dc81eb4dfce66eaa05: start","job_status":"start","queue_duration_s":0.458412,"scheduling_latency_s":0.458442}2462gitlab # [ 424.793563] gitaly[888]: time="2026-08-16T12:38:04.876Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF diskcache=e1b76f8d-8f04-4fea-916b-4a90eb451e13 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:34.637" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.738" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2463gitlab # [ 424.804119] gitaly[888]: time="2026-08-16T12:38:04.876Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=122 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6957 command.oublock=0 command.real_time_ms=131 command.spawn_token_fork_ms=1 command.system_time_ms=82 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:34.637" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:04.738" grpc.time_ms=137.851 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2464gitlab # [ 424.817298] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ed3116dc81eb4dfce66eaa05","created_at":"2026-08-16T12:38:04.896Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.899Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ed3116dc81eb4dfce66eaa05: done: 0.064388 sec","job_status":"done","queue_duration_s":0.458412,"scheduling_latency_s":0.458442,"redis_calls":7,"redis_duration_s":0.004835,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064388,"completed_at":"2026-08-16T12:38:05.421Z","load_balancing_strategy":"primary","db_duration_s":0.011343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2465gitlab # [ 424.860337] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.424Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f4a3dd65eaf2ab4db4b5f546","created_at":"2026-08-16T12:38:04.910Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.915Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f4a3dd65eaf2ab4db4b5f546: start","job_status":"start","queue_duration_s":0.508836,"scheduling_latency_s":0.508867}2466gitlab # [ 424.876214] gitaly[888]: time="2026-08-16T12:38:04.878Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:34.777" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:04.877" grpc.time_ms=0.332 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2467gitlab # [ 424.888891] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f4a3dd65eaf2ab4db4b5f546","created_at":"2026-08-16T12:38:04.910Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.915Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f4a3dd65eaf2ab4db4b5f546: done: 0.051795 sec","job_status":"done","queue_duration_s":0.508836,"scheduling_latency_s":0.508867,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000448,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00067,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051795,"completed_at":"2026-08-16T12:38:05.475Z","load_balancing_strategy":"primary","db_duration_s":0.012425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 424.933179] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.477Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1f6fe9534c5dbf4e34f12391","created_at":"2026-08-16T12:38:04.916Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.919Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1f6fe9534c5dbf4e34f12391: start","job_status":"start","queue_duration_s":0.557751,"scheduling_latency_s":0.557775}2469gitlab # [ 424.949812] gitaly[888]: time="2026-08-16T12:38:04.951Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:34.850" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:04.950" grpc.time_ms=0.881 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2470gitlab # [ 424.962867] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1f6fe9534c5dbf4e34f12391","created_at":"2026-08-16T12:38:04.916Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.919Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1f6fe9534c5dbf4e34f12391: done: 0.040363 sec","job_status":"done","queue_duration_s":0.557751,"scheduling_latency_s":0.557775,"redis_calls":7,"redis_duration_s":0.001337,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040363,"completed_at":"2026-08-16T12:38:05.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2471gitlab # [ 425.006550] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"278af382cdbcc1a0ae0efd62","created_at":"2026-08-16T12:38:04.921Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.924Z","job_size_bytes":19,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-278af382cdbcc1a0ae0efd62: start","job_status":"start","queue_duration_s":0.594706,"scheduling_latency_s":0.594726}2472gitlab # [ 425.024284] gitaly[888]: time="2026-08-16T12:38:04.996Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598G6QCGJ0RCVP6ZBC8QTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:34.895" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:04.995" grpc.time_ms=1.145 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2473gitlab # [ 425.036828] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.557Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"278af382cdbcc1a0ae0efd62","created_at":"2026-08-16T12:38:04.921Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.924Z","job_size_bytes":19,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-278af382cdbcc1a0ae0efd62: done: 0.038092 sec","job_status":"done","queue_duration_s":0.594706,"scheduling_latency_s":0.594726,"redis_calls":8,"redis_duration_s":0.007969,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005071,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002898,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038092,"completed_at":"2026-08-16T12:38:05.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 425.080188] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.561Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7e6fa734bd3caf61260a273","created_at":"2026-08-16T12:38:04.925Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.928Z","job_size_bytes":66,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7e6fa734bd3caf61260a273: start","job_status":"start","queue_duration_s":0.633421,"scheduling_latency_s":0.633441}2475gitlab # [ 425.097572] gitaly[888]: time="2026-08-16T12:38:05.482Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598JAJ1316TSHP06S6JXF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:35.381" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:05.481" grpc.time_ms=0.783 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2476gitlab # [ 425.110115] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.586Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7e6fa734bd3caf61260a273","created_at":"2026-08-16T12:38:04.925Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.928Z","job_size_bytes":66,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7e6fa734bd3caf61260a273: done: 0.02439 sec","job_status":"done","queue_duration_s":0.633421,"scheduling_latency_s":0.633441,"redis_calls":7,"redis_duration_s":0.00122,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02439,"completed_at":"2026-08-16T12:38:05.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 425.153131] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.587Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e54d6a47ee61cb385f80f232","created_at":"2026-08-16T12:38:04.928Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.931Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e54d6a47ee61cb385f80f232: start","job_status":"start","queue_duration_s":0.656242,"scheduling_latency_s":0.656263}2478gitlab # [ 425.169191] gitaly[888]: time="2026-08-16T12:38:05.739Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:35.637" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:05.737" grpc.time_ms=1.5 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2479gitlab # [ 425.181776] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.612Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e54d6a47ee61cb385f80f232","created_at":"2026-08-16T12:38:04.928Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.931Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e54d6a47ee61cb385f80f232: done: 0.025414 sec","job_status":"done","queue_duration_s":0.656242,"scheduling_latency_s":0.656263,"redis_calls":7,"redis_duration_s":0.001546,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025414,"completed_at":"2026-08-16T12:38:05.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2480gitlab # [ 425.225291] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.614Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"df46c0c2ce5b17c3ccf9cf40","created_at":"2026-08-16T12:38:04.931Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.934Z","job_size_bytes":6,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-df46c0c2ce5b17c3ccf9cf40: start","job_status":"start","queue_duration_s":0.679984,"scheduling_latency_s":0.680002}2481gitlab # [ 425.241792] gitaly[888]: time="2026-08-16T12:38:05.788Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598HJ636PDDD2RAJW229DK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:35.686" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:05.787" grpc.time_ms=1.287 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2482gitlab # [ 425.254352] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"df46c0c2ce5b17c3ccf9cf40","created_at":"2026-08-16T12:38:04.931Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.934Z","job_size_bytes":6,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-df46c0c2ce5b17c3ccf9cf40: done: 0.014264 sec","job_status":"done","queue_duration_s":0.679984,"scheduling_latency_s":0.680002,"redis_calls":7,"redis_duration_s":0.001514,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014264,"completed_at":"2026-08-16T12:38:05.628Z","load_balancing_strategy":"primary","db_duration_s":0.000308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 425.296489] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3c5076d7cab7c93909ed561d","created_at":"2026-08-16T12:38:04.934Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.937Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3c5076d7cab7c93909ed561d: start","job_status":"start","queue_duration_s":0.692947,"scheduling_latency_s":0.692964}2484gitlab # [ 425.311880] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.653Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3c5076d7cab7c93909ed561d","created_at":"2026-08-16T12:38:04.934Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.937Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3c5076d7cab7c93909ed561d: done: 0.023722 sec","job_status":"done","queue_duration_s":0.692947,"scheduling_latency_s":0.692964,"redis_calls":7,"redis_duration_s":0.0017200000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023722,"completed_at":"2026-08-16T12:38:05.653Z","load_balancing_strategy":"primary","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2485gitlab # [ 425.353836] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.655Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6d1b7d73e306892a399d26cc","created_at":"2026-08-16T12:38:04.971Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.975Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6d1b7d73e306892a399d26cc: start","job_status":"start","queue_duration_s":0.679255,"scheduling_latency_s":0.679272}2486gitlab # [ 425.369877] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.814Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6d1b7d73e306892a399d26cc","created_at":"2026-08-16T12:38:04.971Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-0efa28b8e76440a5","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:04.975Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6d1b7d73e306892a399d26cc: done: 0.158884 sec","job_status":"done","queue_duration_s":0.679255,"scheduling_latency_s":0.679272,"gitaly_calls":2,"gitaly_duration_s":0.008149,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010277999999999999,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001328,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001576,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000325,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003048,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000314,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000829,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107029,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11344844,"duration_s":0.158884,"completed_at":"2026-08-16T12:38:05.814Z","load_balancing_strategy":"primary","db_duration_s":0.042136,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2487gitlab # [ 425.421616] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.817Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2401ad43492d984ccfd0bcec","created_at":"2026-08-16T12:38:05.010Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:05.012Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2401ad43492d984ccfd0bcec: start","job_status":"start","queue_duration_s":0.805525,"scheduling_latency_s":0.805565}2488gitlab # [ 425.438182] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.878Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2401ad43492d984ccfd0bcec","created_at":"2026-08-16T12:38:05.010Z","trace_propagation_headers":{"sentry-trace":"8abc34be803d42cf9be5296d91fa9cc4-b7d30cf83b044ce8","baggage":"sentry-trace_id=8abc34be803d42cf9be5296d91fa9cc4,sentry-release=Unknown"},"correlation_id":"01M0598G6QCGJ0RCVP6ZBC8QTF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:05.012Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2401ad43492d984ccfd0bcec: done: 0.061366 sec","job_status":"done","queue_duration_s":0.805525,"scheduling_latency_s":0.805565,"redis_calls":8,"redis_duration_s":0.003748,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002918,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061366,"completed_at":"2026-08-16T12:38:05.878Z","load_balancing_strategy":"primary","db_duration_s":0.006944,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2489gitlab # [ 425.479989] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.882Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"93043b7e8921bae5c147cec4","created_at":"2026-08-16T12:38:05.719Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-c1dfac5b6a684544","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:05.721Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-93043b7e8921bae5c147cec4: start","job_status":"start","queue_duration_s":0.160934,"scheduling_latency_s":0.160975}2490gitlab # [ 425.495909] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:05.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"93043b7e8921bae5c147cec4","created_at":"2026-08-16T12:38:05.719Z","trace_propagation_headers":{"sentry-trace":"423b3d08d23f4ce0b4d734ad5418df42-c1dfac5b6a684544","baggage":"sentry-trace_id=423b3d08d23f4ce0b4d734ad5418df42,sentry-release=Unknown"},"correlation_id":"01M0598HJ636PDDD2RAJW229DK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:05.721Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-93043b7e8921bae5c147cec4: done: 0.085178 sec","job_status":"done","queue_duration_s":0.160934,"scheduling_latency_s":0.160975,"redis_calls":7,"redis_duration_s":0.003221,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085178,"completed_at":"2026-08-16T12:38:05.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2491gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2492gitlab # [ 425.860242] gitaly[888]: time="2026-08-16T12:38:06.744Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598KH64AEHZVB4P58QFCSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:36.541" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:06.742" grpc.time_ms=1.191 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2493gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.27 seconds)2494gitlab # [ 425.925116] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1782495gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2496gitlab # [ 427.088248] gitaly[888]: time="2026-08-16T12:38:07.972Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598MQSCHMZ1CG20HTJB2MJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:37.869" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:07.970" grpc.time_ms=1.289 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.22 seconds)2498gitlab # [ 427.144290] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1612499gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2500gitlab # [ 428.293229] gitaly[888]: time="2026-08-16T12:38:09.177Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598NXW41DZEGZKVMSETHNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:39.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:09.175" grpc.time_ms=1.311 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2501gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.20 seconds)2502gitlab # [ 428.348301] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1472503gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2504gitlab # [ 429.469200] gitaly[888]: time="2026-08-16T12:38:10.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:40.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:10.351" grpc.time_ms=1.397 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2505gitlab # [ 429.595370] gitaly[888]: time="2026-08-16T12:38:10.480Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:20.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:10.462" grpc.time_ms=17.672 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2506gitlab # [ 429.634465] gitaly[888]: time="2026-08-16T12:38:10.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q3GQ6KCQFVA7ZRPWVZK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:40.396" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:10.497" grpc.time_ms=1.199 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2507gitlab # [ 429.717623] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4082508gitlab # [ 429.724259] nixbot[3535]: {"ts": "2026-08-16T12:38:10.604Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b \"HTTP/1.1 201 Created\""}2509gitlab # [ 429.800664] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 3972510gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.46 seconds)2511gitlab # [ 429.851641] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:10.734Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"82c4e603fa3ed0b5385af5e8","created_at":"2026-08-16T12:38:10.559Z","trace_propagation_headers":{"sentry-trace":"45e8b5c4d160450ba62a90390df04225-0ce5a7c2203a46b7","baggage":"sentry-trace_id=45e8b5c4d160450ba62a90390df04225,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598Q0G27WDVF84QANP7XMQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.576Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-82c4e603fa3ed0b5385af5e8: start","job_status":"start","queue_duration_s":0.157379,"scheduling_latency_s":0.157412}2512gitlab # [ 429.902563] gitaly[888]: time="2026-08-16T12:38:10.787Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598QDWWQFWVFTTH53EW3TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:40.685" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:10.785" grpc.time_ms=1.624 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2513gitlab # [ 430.001231] gitaly[888]: time="2026-08-16T12:38:10.886Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598QDWWQFWVFTTH53EW3TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:20.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:10.870" grpc.time_ms=15.679 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2514gitlab # [ 430.099580] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3632515gitlab # [ 430.107164] nixbot[3535]: {"ts": "2026-08-16T12:38:10.986Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b \"HTTP/1.1 201 Created\""}2516gitlab # [ 430.221698] gitaly[888]: time="2026-08-16T12:38:11.106Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598QSW5FN4AYHPPHB40HFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:41.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:11.105" grpc.time_ms=1.304 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2517gitlab # [ 430.312418] gitaly[888]: time="2026-08-16T12:38:11.197Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0598QSW5FN4AYHPPHB40HFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T12:38:21.070" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.180" grpc.time_ms=16.134 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2518gitlab # [ 430.343305] gitaly[888]: time="2026-08-16T12:38:11.228Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:11.222" grpc.time_ms=1.13 pid=888 span.kind=server system=grpc2519gitlab # [ 430.383494] gitaly[888]: time="2026-08-16T12:38:11.268Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:11.267" grpc.time_ms=0.605 pid=888 span.kind=server system=grpc2520gitlab # [ 430.419783] gitaly[888]: time="2026-08-16T12:38:11.304Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T12:38:11.303" grpc.time_ms=1.368 pid=888 span.kind=server system=grpc2521gitlab # [ 430.436531] gitaly[888]: time="2026-08-16T12:38:11.317Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" operations="[repack_refs]" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2522gitlab # [ 430.452669] gitaly[888]: time="2026-08-16T12:38:11.320Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" pid=888 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 12:36:25.14949852 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2523gitlab # [ 430.469543] nixbot[3535]: {"ts": "2026-08-16T12:38:11.313Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b \"HTTP/1.1 201 Created\""}2524gitlab # [ 430.473449] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af316e3e5861a347607e4be841fa74f44ba6ab6b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3072525gitlab # [ 430.477221] gitaly[888]: time="2026-08-16T12:38:11.325Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ diskcache=c721df85-775c-4619-9e3e-eb9134e2360e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2526gitlab # [ 430.489087] gitaly[888]: time="2026-08-16T12:38:11.325Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7234 command.oublock=0 command.real_time_ms=165 command.spawn_token_fork_ms=1 command.system_time_ms=71 command.user_time_ms=72 component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" grpc.time_ms=176.643 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab # [ 430.503587] gitaly[888]: time="2026-08-16T12:38:11.348Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" pid=888 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2528gitlab # [ 430.517169] gitaly[888]: time="2026-08-16T12:38:11.349Z" level=info msg="optimized repository" clean_stale_data_time=27.7137ms clean_work_trees_time="140.6µs" commit_graph_time=600ns correlation_id=01M0598Q0G27WDVF84QANP7XMQ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.54µs" pid=888 prune_time=220ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.7µs" storage_name=default system=housekeeping total_time=27.89688ms2529gitlab # [ 430.523020] gitaly[888]: time="2026-08-16T12:38:11.349Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T12:38:41.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T12:38:11.148" pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2530gitlab # [ 430.562425] nix-daemon[3751]: accepted connection from pid 4508, user nixbot2531gitlab # [ 430.591660] gitaly[888]: time="2026-08-16T12:38:11.476Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T12:38:41.375" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:11.475" grpc.time_ms=0.891 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2532gitlab # [ 430.642118] gitaly[888]: time="2026-08-16T12:38:11.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0598Q0G27WDVF84QANP7XMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T12:38:41.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T12:38:11.525" grpc.time_ms=1.07 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2533gitlab # [ 430.661625] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.546Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"931b3b17c4daf87323461869","created_at":"2026-08-16T12:38:11.542Z","trace_propagation_headers":{"sentry-trace":"45e8b5c4d160450ba62a90390df04225-db71330765784f50","baggage":"sentry-trace_id=45e8b5c4d160450ba62a90390df04225,sentry-release=Unknown"},"correlation_id":"01M0598Q0G27WDVF84QANP7XMQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"82c4e603fa3ed0b5385af5e8","job_size_bytes":3,"pid":3427,"job_status":"deduplicated","message":"PipelineProcessWorker JID-931b3b17c4daf87323461869: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2534gitlab # [ 430.680211] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.549Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"82c4e603fa3ed0b5385af5e8","created_at":"2026-08-16T12:38:10.559Z","trace_propagation_headers":{"sentry-trace":"45e8b5c4d160450ba62a90390df04225-0ce5a7c2203a46b7","baggage":"sentry-trace_id=45e8b5c4d160450ba62a90390df04225,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598Q0G27WDVF84QANP7XMQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.576Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3427,"job_status":"rescheduled","message":"PipelineProcessWorker JID-82c4e603fa3ed0b5385af5e8: rescheduled"}2535gitlab # [ 430.696891] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.562Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"82c4e603fa3ed0b5385af5e8","created_at":"2026-08-16T12:38:10.559Z","trace_propagation_headers":{"sentry-trace":"45e8b5c4d160450ba62a90390df04225-0ce5a7c2203a46b7","baggage":"sentry-trace_id=45e8b5c4d160450ba62a90390df04225,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0598Q0G27WDVF84QANP7XMQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.576Z","job_size_bytes":3,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-82c4e603fa3ed0b5385af5e8: done: 0.828398 sec","job_status":"done","queue_duration_s":0.157379,"scheduling_latency_s":0.157412,"gitaly_calls":3,"gitaly_duration_s":0.202237,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.08581,"redis_read_bytes":248,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.009786,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002114,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.037043,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.017106,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.003608,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001365,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005002,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.21,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.04,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.05,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.104,"db_ci_duration_s":0.106,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.287107,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.61805936,"duration_s":0.828398,"completed_at":"2026-08-16T12:38:11.562Z","load_balancing_strategy":"primary","db_duration_s":0.316135,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2536gitlab # [ 430.748676] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6d2af41f09d05027afb04be1","created_at":"2026-08-16T12:38:10.559Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7b9ee086791db7d5a87585e80c902ca","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.761Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6d2af41f09d05027afb04be1: start","job_status":"start","queue_duration_s":0.802952,"scheduling_latency_s":0.802983}2537gitlab # [ 430.765017] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1092538gitlab # [ 430.767105] gitaly[888]: time="2026-08-16T12:38:11.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0598R9TSXR1X1M7ZNEJ7ED6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T12:38:11.611" grpc.time_ms=11.616 pid=888 remote_ip="2001:db8:1::1" span.kind=server system=grpc2539gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses2540gitlab # [ 430.780855] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"6d2af41f09d05027afb04be1","created_at":"2026-08-16T12:38:10.559Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7b9ee086791db7d5a87585e80c902ca","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.761Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-6d2af41f09d05027afb04be1: done: 0.070757 sec","job_status":"done","queue_duration_s":0.802952,"scheduling_latency_s":0.802983,"redis_calls":9,"redis_duration_s":0.002678,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.070757,"completed_at":"2026-08-16T12:38:11.635Z","load_balancing_strategy":"primary","db_duration_s":0.033239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2541gitlab # [ 430.822934] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8da8426d1c8665c6c2c49176","created_at":"2026-08-16T12:38:10.767Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2537ced68bbd9e1f5662e42752f0ac1c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.772Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8da8426d1c8665c6c2c49176: start","job_status":"start","queue_duration_s":0.864753,"scheduling_latency_s":0.864783}2542gitlab # [ 430.862354] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8da8426d1c8665c6c2c49176","created_at":"2026-08-16T12:38:10.767Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2537ced68bbd9e1f5662e42752f0ac1c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.772Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8da8426d1c8665c6c2c49176: done: 0.069722 sec","job_status":"done","queue_duration_s":0.864753,"scheduling_latency_s":0.864783,"redis_calls":9,"redis_duration_s":0.002479,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069722,"completed_at":"2026-08-16T12:38:11.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2543gitlab # [ 430.920896] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.709Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"137474d174b1ede2da735a51","created_at":"2026-08-16T12:38:10.787Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ac6b0dce0f4b4a7be1517a67704a40","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.796Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-137474d174b1ede2da735a51: start","job_status":"start","queue_duration_s":0.912727,"scheduling_latency_s":0.91276}2544gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e5861a347607e4be841fa74f44ba6ab6b/statuses, in 0.16 seconds)2545(finished: subtest: eval and build post commit statuses, in 6.51 seconds)2546(finished: run the VM test script, in 499.31 seconds)2547gitlab # [ 430.935656] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"137474d174b1ede2da735a51","created_at":"2026-08-16T12:38:10.787Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ac6b0dce0f4b4a7be1517a67704a40","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.796Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-137474d174b1ede2da735a51: done: 0.040208 sec","job_status":"done","queue_duration_s":0.912727,"scheduling_latency_s":0.91276,"redis_calls":9,"redis_duration_s":0.001984,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040208,"completed_at":"2026-08-16T12:38:11.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2548gitlab # [ 430.979048] sidekiq-cluster[3427]: {"severity":"INFO","time":"2026-08-16T12:38:11.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5aee7be4058ee9ac9df9f00f","created_at":"2026-08-16T12:38:10.802Z","trace_propagation_headers":{"sentry-trace":"2007e5e555934877bfc7d2761ce85308-f61bfb1b7a904290","baggage":"sentry-trace_id=2007e5e555934877bfc7d2761ce85308,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ec5de7f912800985b936a2ba376b544","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T12:38:10.811Z","job_size_bytes":2,"pid":3427,"sidekiq_tid":"m8ln","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5aee7be4058ee9ac9df9f00f: start","job_status":"start","queue_duration_s":0.939663,"scheduling_latency_s":0.939687}2549gitlab # [ 430.996226] gitlab-workhorse[821]: time="2026-08-16T12:38:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672550test script finished in 499.35s2551cleanup2552gitlab # [ 430.998062] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1272553kill QemuMachine (pid 46)2554gitlab # [ 430.999914] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:12:38:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af316e3e586qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2555(finished: cleanup, in 1.33 seconds)2556additionally exposed symbols:2557 gitlab,2558 vlan1,2559 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2560[]2561[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T12:36:33.520Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2562[]2563[]2564[]2565[]2566[]2567[]2568[]2569[]2570[]2571[]2572[]2573[]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[]2585[]2586[]2587[]2588[]2589[]2590[]2591[]2592[]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[]2601[]2602[]2603[]2604[]2605[]2606[]2607[]2608[]2609[]2610[]2611[]2612[]2613[]2614[]2615[]2616[]2617[]2618[]2619[]2620[]2621[]2622[]2623[]2624[]2625[]2626[]2627[]2628[]2629[]2630[]2631[]2632[]2633[]2634[]2635[]2636[]2637[]2638[]2639[]2640[]2641[]2642[]2643[]2644[]2645[]2646[]2647[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T12:38:04.608561Z', 'started_at': '2026-08-16T12:38:05.001045Z', 'finished_at': None}]2648[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2649[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2650[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2651[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2652[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': '2026-08-16T12:38:10.543Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2653[{'id': 5, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T12:38:04.962Z', 'started_at': None, 'finished_at': '2026-08-16T12:38:10.543Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'af316e3e5861a347607e4be841fa74f44ba6ab6b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T12:38:10.932Z', 'started_at': None, 'finished_at': '2026-08-16T12:38:11.266Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]