vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #293
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.Bxjgi4ayS4', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 6e97d083-251b-4af6-b19b-c967c38fc0be16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19(finished: start all VMs, in 73.16 seconds)20gitlab # Allocating group tables: 0/8 done21gitlab: waiting for unit setup-gitlab.service22gitlab # Writing inode tables: 0/8 done23gitlab: waiting for the VM to finish booting24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5qhxsmvnzdq853q7qgmcisxxnhp7l84r-nixos-system-gitlab-test/init regInfo=/nix/store/whjnj4xblqq19svwfhcwm53sk2vhmhka-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/whjnj4xblqq19svwfhcwm53sk2vhmhka-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000030] arm-pv: using stolen time PV108gitlab # [ 0.000451] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000669] Console: colour dummy device 80x25110gitlab # [ 0.000676] printk: legacy console [tty0] enabled111gitlab # [ 0.000894] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000901] pid_max: default: 32768 minimum: 301113gitlab # [ 0.001000] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001167] landlock: Up and running.115gitlab # [ 0.001172] Yama: becoming mindful.116gitlab # [ 0.001711] LSM support for eBPF active117gitlab # [ 0.001966] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.002079] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003330] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004170] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004175] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004339] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005388] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005480] EFI services will not be available.125gitlab # [ 0.005691] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006363] Detected PIPT I-cache on CPU1127gitlab # [ 0.006481] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006618] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006757] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007865] Detected PIPT I-cache on CPU2131gitlab # [ 0.007972] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.008104] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.008235] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.009365] Detected PIPT I-cache on CPU3135gitlab # [ 0.009525] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009670] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009839] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.010776] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.010804] SMP: Total of 4 processors activated.140gitlab # [ 0.010806] CPU: All CPU(s) started at EL1141gitlab # [ 0.010816] CPU features: detected: Branch Target Identification142gitlab # [ 0.010820] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.010823] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.010826] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.010830] CPU features: detected: Common not Private translations146gitlab # [ 0.010833] CPU features: detected: CRC32 instructions147gitlab # [ 0.010836] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.010840] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.010843] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.010846] CPU features: detected: E0PD151gitlab # [ 0.010848] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.010851] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.010854] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.010857] CPU features: detected: Fine Grained Traps155gitlab # [ 0.010861] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.010865] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.010868] CPU features: detected: LSE atomic instructions158gitlab # [ 0.010871] CPU features: detected: Privileged Access Never159gitlab # [ 0.010873] CPU features: detected: PMUv3160gitlab # [ 0.010876] CPU features: detected: RAS Extension Support161gitlab # [ 0.010879] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.010882] CPU features: detected: Random Number Generator163gitlab # [ 0.010884] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.010887] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.010890] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.010893] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.011018] alternatives: applying system-wide alternatives168gitlab # [ 0.014102] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014330] Memory: 5963808K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.016054] devtmpfs: initialized171gitlab # [ 0.020333] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.020408] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.020606] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.020610] 0 pages in range for non-PLT usage175gitlab # [ 0.020612] 508288 pages in range for PLT usage176gitlab # [ 0.020742] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.021636] DMI not present or invalid.178gitlab # [ 0.025229] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.027903] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.028234] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.030092] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.030141] audit: initializing netlink subsys (disabled)183gitlab # [ 0.030529] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.031039] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.031042] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.031046] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.031049] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.031051] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.031148] cpuidle: using governor ladder190gitlab # [ 0.031174] cpuidle: using governor menu191gitlab # [ 0.031384] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.031608] ASID allocator initialised with 65536 entries193gitlab # [ 0.032762] Serial: AMBA PL011 UART driver194gitlab # [ 0.038235] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.038611] printk: console [ttyAMA0] enabled196gitlab # [ 0.049304] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.049325] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.049334] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.049342] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.049351] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.049359] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.049367] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.049375] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.060561] fbcon: Taking over console205gitlab # [ 0.060578] ACPI: Interpreter disabled.206gitlab # [ 0.061760] iommu: Default domain type: Translated207gitlab # [ 0.061778] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.074251] SCSI subsystem initialized209gitlab # [ 0.074670] usbcore: registered new interface driver usbfs210gitlab # [ 0.074705] usbcore: registered new interface driver hub211gitlab # [ 0.074722] usbcore: registered new device driver usb212gitlab # [ 0.074991] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.074995] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.075004] PTP clock support registered215gitlab # [ 0.075056] EDAC MC: Ver: 3.0.0216gitlab # [ 0.075627] scmi_core: SCMI protocol bus registered217gitlab # [ 0.076758] FPGA manager framework218gitlab # [ 0.077451] vgaarb: loaded219gitlab # [ 0.079213] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.079722] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.079751] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.080736] netfs: FS-Cache loaded223gitlab # [ 0.081075] pnp: PnP ACPI: disabled224gitlab # [ 0.095886] NET: Registered PF_INET protocol family225gitlab # [ 0.098843] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.164484] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.164569] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.164648] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.165166] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.166066] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.166287] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.166384] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.166574] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.166950] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.167074] NET: Registered PF_XDP protocol family236gitlab # [ 0.167103] PCI: CLS 0 bytes, default 64237gitlab # [ 0.167551] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.180273] kvm [1]: HYP mode not available239gitlab # [ 0.260856] Initialise system trusted keyrings240gitlab # [ 0.261291] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.262827] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.263066] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.302535] Key type asymmetric registered244gitlab # [ 0.302577] Asymmetric key parser 'x509' registered245gitlab # [ 0.302728] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.303251] io scheduler mq-deadline registered247gitlab # [ 0.303269] io scheduler kyber registered248gitlab # [ 0.320314] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.327568] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.328913] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.328951] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.328999] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.329016] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.329102] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.329229] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.329515] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.329539] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.329713] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.329751] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.329762] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.330029] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.331539] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.332193] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.332236] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.332337] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.332381] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.333915] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.334566] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.334607] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.334697] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.336338] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.336938] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.336976] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.337076] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.338769] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.339385] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.339421] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.339526] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.341160] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.341778] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.341814] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.341894] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.343482] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.344109] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.344152] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.344238] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.345837] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.346452] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.346495] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.346587] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.346629] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.348391] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.349013] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.349113] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.350750] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.351469] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.351555] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.352913] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.353677] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.354641] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.355413] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.355461] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.355542] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.357204] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.357825] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.357870] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.357950] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.359987] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.360007] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.360018] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.360156] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.360286] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.360429] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.360567] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.360732] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.360877] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.361034] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.361194] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.361346] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.361549] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.361705] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.361768] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.361829] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.361891] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.361954] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.362015] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.362076] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.362133] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.362188] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.362243] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.362299] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.362355] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.362408] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.362461] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.362514] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.362566] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.362619] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.362678] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.362737] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.362798] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.362854] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.362918] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.362934] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.362943] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.367272] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.397256] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.401550] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.405770] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.411979] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.415695] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.419565] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.425782] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.429883] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.433797] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.439698] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.444090] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.454804] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.458302] msm_serial: driver initialized359gitlab # [ 0.458630] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.458720] STM32 USART driver initialized361gitlab # [ 0.497304] loop: module loaded362gitlab # [ 0.497620] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.500604] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.503716] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.506851] virtio_blk virtio5: [vdb] 12283432 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.510404] megasas: 07.734.00.00-rc1367gitlab # [ 0.511650] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.514645] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.514677] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.517351] Using buffer write method371gitlab # [ 0.517407] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.520452] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.520481] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.524413] Using buffer write method375gitlab # [ 0.524441] Concatenating MTD devices:376gitlab # [ 0.524445] (0): "0.flash"377gitlab # [ 0.524449] (1): "0.flash"378gitlab # [ 0.524452] into device "0.flash"379gitlab # [ 0.688925] Freeing initrd memory: 27184K380gitlab # [ 0.706903] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.715732] thunder_xcv, ver 1.0382gitlab # [ 0.715834] thunder_bgx, ver 1.0383gitlab # [ 0.715913] nicpf, ver 1.0384gitlab # [ 0.717681] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.717693] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.717760] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.717775] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.717846] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.717855] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.717931] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.717941] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.718332] sky2: driver version 1.30393gitlab # [ 0.723487] usbcore: registered new interface driver usb-storage394gitlab # [ 0.723738] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.723827] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.723998] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.724045] usbserial: USB Serial support registered for generic398gitlab # [ 0.724536] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.725877] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.728518] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.728576] rtc-pl031 9010000.pl031: setting system clock to 2026-09-01T10:31:31 UTC (1788258691)402gitlab # [ 0.729590] i2c_dev: i2c /dev entries driver403gitlab # [ 0.738344] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.738359] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.739271] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.739376] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00407gitlab # [ 0.740492] sdhci-pltfm: SDHCI platform and OF driver helper408gitlab # [ 0.740535] hub 1-0:1.0: USB hub found409gitlab # [ 0.740582] hub 1-0:1.0: 6 ports detected410gitlab # [ 0.745075] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.745876] usbcore: registered new interface driver usbhid412gitlab # [ 0.745886] usbhid: USB HID core driver413gitlab # [ 0.756311] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.760555] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.760877] NET: Registered PF_INET6 protocol family416gitlab # [ 0.763166] Segment Routing with IPv6417gitlab # [ 0.763211] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.763467] NET: Registered PF_PACKET protocol family419gitlab # [ 0.763858] 9pnet: Installing 9P2000 support420gitlab # [ 0.767809] Key type dns_resolver registered421gitlab # [ 0.784369] registered taskstats version 1422gitlab # [ 0.784829] Loading compiled-in X.509 certificates423gitlab # [ 0.805866] Demotion targets for Node 0: null424gitlab # [ 0.806131] Key type .fscrypt registered425gitlab # [ 0.806139] Key type fscrypt-provisioning registered426gitlab # [ 0.806335] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.806359] ima: Allocated hash algorithm: sha1428gitlab # [ 0.806397] ima: No architecture policies found429gitlab # [ 0.807725] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.832959] clk: Disabling unused clocks431gitlab # [ 0.832996] PM: genpd: Disabling unused power domains432gitlab # [ 0.837354] Freeing unused kernel memory: 4736K433gitlab # [ 0.837598] Run /init as init process434gitlab # [ 0.869561] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.987309] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.144288] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.204066] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.204138] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.204213] systemd[1]: Detected architecture arm64.440gitlab # [ 1.204230] systemd[1]: Running in initrd.441gitlab # [ 1.205127] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.205390] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.275790] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.395307] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.453676] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.549330] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.551448] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.551785] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.580190] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.580618] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.580677] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.580701] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.580743] systemd[1]: Reached target Path Units.454gitlab # [ 1.580774] systemd[1]: Reached target Slice Units.455gitlab # [ 1.580807] systemd[1]: Reached target Swaps.456gitlab # [ 1.580841] systemd[1]: Reached target Timer Units.457gitlab # [ 1.581154] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.581449] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.581725] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.581975] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.582126] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.582161] systemd[1]: Reached target Socket Units.463gitlab # [ 1.585108] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.587963] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.588085] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.591132] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.615631] systemd[1]: Starting Journal Service...468gitlab # [ 1.623427] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.623610] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.625674] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.628057] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.629364] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.634798] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.635409] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.641001] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.656910] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.673826] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0478gitlab # [ 1.674048] [drm] features: -virgl +edid -resource_blob -host_visible479gitlab # [ 1.674055] [drm] features: -context_init480gitlab # [ 1.682811] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.481gitlab # [ 1.683295] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev482gitlab # [ 1.684260] [drm] number of scanouts: 1483gitlab # [ 1.684289] [drm] number of cap sets: 0484gitlab # [ 1.686993] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.485gitlab # [ 1.688821] systemd[1]: Starting Create Static Device Nodes in /dev...486gitlab # [ 1.700402] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.700436] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.709299] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.716527] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.728242] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.730109] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.732149] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.737986] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.737170] systemd-modules-load[96]: Using 4 probe threads495gitlab # [ 1.741292] systemd[1]: Started Journal Service.496gitlab # [ 1.740850] systemd-modules-load[96]: Module 'virtio_console' is built in497gitlab # [ 1.742200] systemd-modules-load[96]: Module 'virtio_balloon' is built in498gitlab # [ 1.743423] systemd-modules-load[96]: Module 'virtio_rng' is built in499gitlab # [ 1.744781] systemd-modules-load[96]: Inserted module 'dm_mod'500gitlab # [ 1.746141] systemd-modules-load[96]: Inserted module 'virtio_gpu'501gitlab # [ 1.747288] systemd[1]: Finished Load Kernel Modules.502gitlab # [ 1.748332] systemd[1]: Starting Apply Kernel Variables...503gitlab # [ 1.752657] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.780457] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.789248] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.795995] systemd-udevd[106]: Using default interface naming scheme 'v261'.507gitlab # [ 1.818145] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.846269] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.885267] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.890284] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.272445] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.275136] systemd[1]: Reached target System Initialization.513gitlab # [ 2.277734] systemd[1]: Reached target Basic System.514gitlab # [ 2.467151] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.472664] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.492482] (udev-worker)[142]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.508114] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.509774] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.515158] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.531746] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.570003] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.574922] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.625228] systemd[1]: Mounting /sysroot...524gitlab # [ 2.673601] EXT4-fs (vda): mounted filesystem 6e97d083-251b-4af6-b19b-c967c38fc0be r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.675207] systemd[1]: Mounted /sysroot.526gitlab # [ 2.676083] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.681868] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.684616] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.692484] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.697544] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.702813] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.708862] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.736129] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.737460] systemd[1]: Mounted /sysroot/tmp/shared.535gitlab # [ 2.738587] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.740964] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.754585] systemd[1]: Mounted /sysroot/run.538gitlab # [ 2.764839] systemd[1]: Mounted /sysroot/tmp/xchg.539gitlab # [ 2.766210] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.540gitlab # [ 2.770275] systemd[1]: Finished rw-sysroot-nix-store.service.541gitlab # [ 2.779992] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.783067] systemd[1]: Reloading...543gitlab # [ 2.992913] erofs (device vdb): mounted with root inode @ nid 128.544gitlab # [ 3.043574] systemd[1]: Reloading finished in 262 ms.545gitlab # [ 3.092572] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...546gitlab # [ 3.094179] systemd[1]: Mounted /sysroot/nix/.ro-store.547gitlab # [ 3.097932] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.101890] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 3.103314] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 3.104682] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 3.106861] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 3.133299] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.134521] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.141861] (udev-worker)[146]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.144757] (udev-worker)[146]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.156462] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.157678] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.158414] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.159165] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.193912] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.195788] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.631601] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.703385] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.705751] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.708267] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.711136] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.756925] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.761049] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.781664] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.784150] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.786631] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.845979] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.848530] systemd[1]: Stopped target Basic System.574gitlab # [ 3.850687] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.853144] systemd[1]: Stopped target Path Units.576gitlab # [ 3.855237] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.858642] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.861941] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.864104] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.866333] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.872102] systemd[1]: Stopped target Swaps.582gitlab # [ 3.874287] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.882774] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.886983] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.889841] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.892997] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.895203] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.897606] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.899688] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.902191] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.903910] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.906163] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.907598] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.910030] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.912078] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.914061] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.915684] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.917175] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.918812] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 3.920617] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 3.921939] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 3.923743] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 3.925481] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 3.926665] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 3.928170] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 3.929636] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 3.931253] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 3.932672] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.934270] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.935581] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 3.937134] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 3.938735] systemd[1]: systemd-udevd.service: Consumed 2.394s CPU time over 2.184s wall clock time, 31.4M memory peak.613gitlab # [ 3.941070] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 3.942664] systemd[1]: Closed udev Control Socket.615gitlab # [ 3.943783] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 3.945066] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 3.946756] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 3.948192] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 3.950168] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 3.951747] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 3.953363] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.040178] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.043540] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.045934] systemd[1]: Reached target Switch Root.625gitlab # [ 4.048104] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.248629] initrd-nixos-activation-start[224]: booting system configuration /nix/store/5qhxsmvnzdq853q7qgmcisxxnhp7l84r-nixos-system-gitlab-test627gitlab # [ 4.322884] initrd-nixos-activation-start[224]: running activation script...628gitlab # [ 4.651721] initrd-nixos-activation-start[247]: setting up /etc...629gitlab # [ 4.823912] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.827258] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.829556] systemd[1]: Starting Switch Root...632gitlab # [ 4.876239] systemd[1]: Switching root.633gitlab # [ 4.988230] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.648753] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.648898] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.649000] systemd[1]: Detected architecture arm64.637gitlab # [ 5.649196] systemd[1]: Detected first boot.638gitlab # [ 5.650672] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 5.925931] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.066109] systemd[1]: Applying preset policy.641gitlab # [ 6.259073] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.431339] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.431748] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.434357] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.439494] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.445731] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.449375] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.449996] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.450720] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.452276] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.453237] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.453993] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.454720] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.455654] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.456765] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.457920] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.459079] systemd[1]: Reached target Path Units.658gitlab # [ 6.460210] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.461339] systemd[1]: Reached target Slice Units.660gitlab # [ 6.462440] systemd[1]: Reached target Swaps.661gitlab # [ 6.466614] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.470964] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.474200] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.477988] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.479397] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.488720] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.491103] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.495717] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.497613] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.498861] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.500016] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.506703] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.508259] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.509817] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.552262] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.557817] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.564220] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.593769] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.602037] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.612563] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.614056] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.631574] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.632808] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.638788] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.650958] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.652290] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.663964] systemd[1]: Starting Journal Service...688gitlab # [ 6.668865] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.677555] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.707492] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 6.708273] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.720090] systemd[1]: Starting Coldplug All udev Devices...693gitlab # [ 6.734601] systemd[1]: Listening on Journal Log Access Socket.694gitlab # [ 6.735666] systemd[1]: Mounted Huge Pages File System.695gitlab # [ 6.736650] systemd[1]: Mounted POSIX Message Queue File System.696gitlab # [ 6.737672] systemd[1]: Mounted Kernel Debug File System.697gitlab # [ 6.738584] systemd[1]: Mounted Kernel Trace File System.698gitlab # [ 6.739979] systemd[1]: Finished Create List of Static Device Nodes.699gitlab # [ 6.741256] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.700gitlab # [ 6.742345] systemd[1]: Finished Load Kernel Module 9pnet_virtio.701gitlab # [ 6.743361] systemd[1]: Mounted Kernel Configuration File System.702gitlab # [ 6.759416] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...703gitlab # [ 6.760525] fuse: init (API version 7.45)704gitlab # [ 6.761187] systemd-journald[318]: Collecting audit messages is enabled.705gitlab # [ 6.769815] systemd[1]: modprobe@fuse.service: Deactivated successfully.706gitlab # [ 6.770811] EXT4-fs (vda): re-mounted 6e97d083-251b-4af6-b19b-c967c38fc0be.707gitlab # [ 6.773734] systemd[1]: Finished Load Kernel Module fuse.708gitlab # [ 6.777428] systemd[1]: Finished Load Kernel Modules.709gitlab # [ 6.778549] systemd[1]: Finished Remount Root and Kernel File Systems.710gitlab # [ 6.779568] systemd[1]: Listening on Disk Image Download Service Socket.711gitlab # [ 6.785742] systemd[1]: Mounting FUSE Control File System...712gitlab # [ 6.794156] systemd[1]: Starting Firewall...713gitlab # [ 6.794721] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore714gitlab # [ 6.812860] systemd[1]: Queued start job for default target Multi-User System.715gitlab # [ 6.814515] systemd[1]: Unnecessary job was removed for /dev/vdb.716gitlab # [ 6.815823] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 6.824796] systemd-modules-load[319]: Using 3 probe threads718gitlab # [ 6.826261] systemd-modules-load[319]: Module 'atkbd' is built in719gitlab # [ 6.827573] systemd-modules-load[319]: Module 'loop' is built in[ 6.832051] systemd[1]: Starting Load/Save OS Random Seed...720gitlab # 721gitlab # [ 6.832291] systemd-modules-load[319]: Inserted module 'tls'722gitlab # [ 6.833970] systemd-oomd[320]: No swap; memory pressure usage will be degraded723gitlab # [ 6.840397] systemd[1]: Starting Apply Kernel Variables...724gitlab # [ 6.840967] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os725gitlab # [ 6.842148] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.[ 6.843889] systemd[1]: Started Journal Service.726gitlab # 727gitlab # [ 6.850616] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.728gitlab # [ 6.852265] systemd[1]: Mounted FUSE Control File System.729gitlab # [ 6.858287] systemd[1]: Finished Load/Save OS Random Seed.730gitlab # [ 6.861731] systemd[1]: Reached target First Boot Complete.731gitlab # [ 6.866930] systemd[1]: Starting Flush Journal to Persistent Storage...732gitlab # [ 6.871683] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 6.885744] systemd-journald[318]: Received client request to flush runtime journal.734gitlab # [ 6.912297] systemd[1]: Finished Apply Kernel Variables.735gitlab # [ 6.914280] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 6.916173] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.917386] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.918976] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.972309] systemd-udevd[357]: Using default interface naming scheme 'v261'.740gitlab # [ 7.017417] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.257976] systemd[1]: Finished Firewall.742gitlab # [ 7.411219] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.435266] systemd[1]: Mounting /run/wrappers...744gitlab # [ 7.463338] systemd[1]: Mounted /run/wrappers.745gitlab # [ 7.465772] systemd[1]: Reached target Local File Systems.746gitlab # [ 7.468634] systemd[1]: Listening on Boot Loader Control Service Socket.747gitlab # [ 7.472521] systemd[1]: Starting register-nix-paths.service...748gitlab # [ 7.476939] systemd[1]: Starting Create SUID/SGID Wrappers...749gitlab # [ 7.481185] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.750gitlab # [ 7.498129] systemd[1]: Starting Save Transient machine-id to Disk...751gitlab # [ 7.505845] systemd[1]: Starting Create System Files and Directories...752gitlab # [ 7.507015] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs753gitlab # [ 7.565402] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.754gitlab # [ 7.566723] systemd[1]: Finished Save Transient machine-id to Disk.755gitlab # [ 7.569555] systemd[1]: Finished Create System Files and Directories.756gitlab # [ 7.595650] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.757gitlab # [ 7.602679] systemd[1]: Starting Rebuild Journal Catalog...758gitlab # [ 7.607146] systemd[1]: Starting Record System Boot/Shutdown in UTMP...759gitlab # [ 7.635682] (udev-worker)[469]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.760gitlab # [ 7.641828] (udev-worker)[469]: Network interface NamePolicy= disabled on kernel command line.761gitlab # [ 7.646880] systemd[1]: Finished Record System Boot/Shutdown in UTMP.762gitlab # [ 7.648798] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.763gitlab # [ 7.657917] systemd[1]: Condition check resulted in Virtio network device being skipped.764gitlab # [ 7.659377] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore765gitlab # [ 7.662802] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.766gitlab # [ 7.665298] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67767gitlab # [ 7.671527] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 7.673589] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os769gitlab # [ 7.675117] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 7.677462] (udev-worker)[418]: Network interface NamePolicy= disabled on kernel command line.771gitlab # [ 7.678921] systemd[1]: Finished Rebuild Journal Catalog.772gitlab # [ 7.681100] systemd[1]: Starting Update is Completed...773gitlab # [ 7.702386] systemd[1]: Finished Update is Completed.774gitlab # [ 7.732942] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.734094] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.734891] systemd[1]: suid-sgid-wrappers.service: Consumed 172ms CPU time over 255ms wall clock time, 6M memory peak, 1.9M read from disk.777gitlab # [ 7.752515] mousedev: PS/2 mouse device common for all mice778gitlab # [ 8.048471] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 8.049473] systemd[1]: Reached target System Initialization.780gitlab # [ 8.050331] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 8.051304] systemd[1]: Started logrotate.timer.782gitlab # [ 8.051995] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 8.052993] systemd[1]: Reached target Timer Units.784gitlab # [ 8.053729] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 8.054657] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 8.065801] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 8.066825] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 8.067984] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 8.069358] systemd[1]: Reached target Socket Units.790gitlab # [ 8.070127] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 8.113253] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 8.115635] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 8.117017] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 8.124388] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 8.137018] dbus-broker-launch[562]: Ready796gitlab # [ 8.141027] systemd[1]: Reached target Basic System.797gitlab # [ 8.144298] systemd[1]: Started backdoor.service.798gitlab # [ 8.148627] systemd[1]: Starting gitlab-config.service...799gitlab # [ 8.173782] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 8.175074] systemd[1]: Starting Logrotate configuration check...801gitlab # [ 8.178182] systemd[1]: Starting Name Service Cache Daemon (nsncd)...802gitlab # connecting to host...803gitlab # [ 8.188874] systemd[1]: Starting Post-Boot Actions...804gitlab # [ 8.191989] systemd[1]: Started Reset console on configuration changes.805gitlab # [ 8.202718] systemd[1]: Starting resolvconf update...806gitlab # [ 8.206937] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab # [ 8.209088] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf808gitlab # [ 8.210461] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'809gitlab # [ 8.211456] logrotate[568]: Reading state from file: /var/lib/logrotate.status810gitlab: Guest shell says: b'Spawning backdoor root shell...\n'811gitlab # [ 8.220320] logrotate[568]: state file /var/lib/logrotate.status does not exist812gitlab # [ 8.221386] logrotate[568]: Allocating hash table for state file, size 64 entries813gitlab: connected to guest root shell814gitlab # [ 8.222294] logrotate[568]: Handling 4 logs815gitlab: (connecting took 8.72 seconds)816gitlab # [ 8.222822] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab: (finished: waiting for the VM to finish booting, in 8.72 seconds)818gitlab # [ 8.225533] logrotate[568]: considering log /var/log/btmp819gitlab # [ 8.228127] logrotate[568]: Creating new state820gitlab # [ 8.228745] logrotate[568]: Now: 2026-09-01 10:31821gitlab # [ 8.229364] logrotate[568]: Last rotated at 2026-09-01 10:00822gitlab # [ 8.230089] logrotate[568]: log does not need rotating (log has already been rotated)823gitlab # [ 8.236576] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed824gitlab # [ 8.238817] logrotate[568]: considering log /var/log/wtmp825gitlab # [ 8.239545] logrotate[568]: Creating new state826gitlab # [ 8.240276] logrotate[568]: Now: 2026-09-01 10:31827gitlab # [ 8.243915] logrotate[568]: Last rotated at 2026-09-01 10:00[ 8.245149] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3828gitlab # 829gitlab # [ 8.246188] logrotate[568]: log does not need rotating (log has already been rotated)830gitlab # [ 8.247200] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed831gitlab # [ 8.249318] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)832gitlab # [ 8.250484] logrotate[568]: considering log /var/gitlab/state/log/*.log833gitlab # [ 8.251371] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping834gitlab # [ 8.253321] logrotate[568]: Creating new state835gitlab # [ 8.254071] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)836gitlab # [ 8.255108] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed837gitlab # [ 8.260134] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)838gitlab # [ 8.262324] logrotate[568]: considering log /var/log/nginx/*.log839gitlab # [ 8.263142] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping840gitlab # [ 8.264242] logrotate[568]: Creating new state841gitlab # [ 8.264868] logrotate[568]: not running postrotate script, since no logs were rotated842gitlab # [ 8.265875] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)843gitlab # [ 8.272103] systemd[1]: Finished Logrotate configuration check.844gitlab # [ 8.274834] nsncd[572]: Sep 01 10:31:39.042 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"845gitlab # [ 8.277059] systemd[1]: Finished Post-Boot Actions.846gitlab # [ 8.278021] systemd[1]: Finished Import lastlog data into lastlog2 database.847gitlab # [ 8.279151] systemd[1]: Started Name Service Cache Daemon (nsncd).848gitlab # [ 8.280264] systemd[1]: Reached target Host and Network Name Lookups.849gitlab # [ 8.281272] systemd[1]: Reached target User and Group Name Lookups.850gitlab # [ 8.287141] systemd[1]: Starting User Login Management...851gitlab # [ 8.325649] systemd[1]: Stopped target Host and Network Name Lookups.852gitlab # [ 8.326808] systemd[1]: Stopping Host and Network Name Lookups...853gitlab # [ 8.327667] systemd[1]: Stopped target User and Group Name Lookups.854gitlab # [ 8.329135] systemd[1]: Stopping User and Group Name Lookups...855gitlab # [ 8.330077] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...856gitlab # [ 8.330931] systemd[1]: nscd.service: Deactivated successfully.857gitlab # [ 8.333388] systemd[1]: Stopped Name Service Cache Daemon (nsncd).858gitlab # [ 8.334339] systemd[1]: nscd.service: Consumed 27ms CPU time over 151ms wall clock time, 7.3M memory peak, 5.8M read from disk.859gitlab # [ 8.378648] systemd[1]: Starting Name Service Cache Daemon (nsncd)...860gitlab # [ 8.384756] systemd[1]: Starting Virtual Console Setup...861gitlab # [ 8.387411] systemd-logind[624]: New seat seat0.862gitlab # [ 8.390542] systemd-logind[624]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)863gitlab # [ 8.391873] systemd-logind[624]: Watching system buttons on /dev/input/event0 (gpio-keys)864gitlab # [ 8.393101] systemd[1]: Started User Login Management.865gitlab # [ 8.402718] systemd[1]: Starting linger-users.service...866gitlab # [ 8.405464] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.867gitlab # [ 8.406636] systemd[1]: Stopped Virtual Console Setup.868gitlab # [ 8.416178] systemd-logind[624]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)869gitlab # [ 8.419039] systemd[1]: Finished resolvconf update.870gitlab # [ 8.421449] systemd[1]: linger-users.service: Deactivated successfully.871gitlab # [ 8.422551] systemd[1]: Finished linger-users.service.872gitlab # [ 8.423855] nsncd[664]: Sep 01 10:31:39.198 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"873gitlab # [ 8.426221] systemd[1]: Started Name Service Cache Daemon (nsncd).874gitlab # [ 8.427062] systemd[1]: Reached target Preparation for Network.875gitlab # [ 8.427950] systemd[1]: Reached target Host and Network Name Lookups.876gitlab # [ 8.429034] systemd[1]: Reached target User and Group Name Lookups.877gitlab # [ 8.431512] systemd[1]: Starting DHCP Client...878gitlab # [ 8.433829] systemd[1]: Starting Address configuration of eth1...879gitlab # [ 8.438063] systemd[1]: Starting Extra networking commands....880gitlab # [ 8.442710] systemd[1]: Starting Virtual Console Setup...881gitlab # [ 8.494960] network-addresses-eth1-start[692]: adding address 192.168.1.1/24... done882gitlab # [ 8.498110] network-addresses-eth1-start[692]: adding address 2001:db8:1::1/64... done883gitlab # [ 8.513304] systemd[1]: Finished Address configuration of eth1.884gitlab # [ 8.533048] systemd-vconsole-setup[694]: Configuration of first virtual console was skipped, ignoring remaining ones.885gitlab # [ 8.536475] systemd[1]: Finished Virtual Console Setup.886gitlab # [ 8.549441] systemd[1]: Finished Extra networking commands..887gitlab # [ 8.550742] systemd[1]: Reached target Network.888gitlab # [ 8.556125] systemd[1]: Starting gitlab-workhorse.service...889gitlab # [ 8.557381] dhcpcd[703]: dhcpcd-10.3.2 starting890gitlab # [ 8.558044] systemd[1]: Starting Nginx Web Server...891gitlab # [ 8.559031] dhcpcd[761]: dev: loaded udev892gitlab # [ 8.563418] systemd[1]: Starting PostgreSQL Server...893gitlab # [ 8.570909] systemd[1]: Starting Redis Server - redis-gitlab...[ 8.574666] 8021q: 802.1Q VLAN Support v1.8894gitlab # 895gitlab # [ 8.575136] 8021q: adding VLAN 0 to HW filter on device eth1896gitlab # [ 8.577159] systemd[1]: Starting Permit User Sessions...897gitlab # [ 8.591619] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.606764] systemd[1]: Finished Permit User Sessions.899gitlab # [ 8.612605] systemd[1]: Started Getty on tty1.900gitlab # [ 8.616935] systemd[1]: Reached target Login Prompts.901gitlab # [ 8.623740] cfg80211: Loading compiled-in X.509 certificates for regulatory database902gitlab # [ 8.629703] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'903gitlab # [ 8.630216] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'904gitlab # [ 8.633489] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2905gitlab # [ 8.633851] cfg80211: failed to load regulatory.db906gitlab # [ 8.681688] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.680962] dhcpcd[761]: eth0: waiting for carrier908gitlab # [ 8.681981] dhcpcd[761]: eth0: carrier acquired909gitlab # [ 8.688116] dhcpcd[761]: DUID 00:01:00:01:32:29:66:0b:52:54:00:12:34:56910gitlab # [ 8.689213] dhcpcd[761]: eth0: IAID 00:12:34:56911gitlab # [ 8.689862] dhcpcd[761]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.755839] nginx-pre-start[790]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.757731] nginx-pre-start[790]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.762067] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.784684] postgresql-pre-start[797]: The files belonging to this database system will be owned by user "postgres".916gitlab # [ 8.791230] postgresql-pre-start[797]: This user must also own the server process.917gitlab # [ 8.792385] postgresql-pre-start[797]: The database cluster will be initialized with locale "en_US.UTF-8".918gitlab # [ 8.793588] postgresql-pre-start[797]: The default database encoding has accordingly been set to "UTF8".919gitlab # [ 8.794777] postgresql-pre-start[797]: The default text search configuration will be set to "english".920gitlab # [ 8.796065] postgresql-pre-start[797]: Data page checksums are enabled.921gitlab # [ 8.797086] postgresql-pre-start[797]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok922gitlab # [ 8.799124] redis-server[796]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.923gitlab # [ 8.801636] systemd[1]: Started Redis Server - redis-gitlab.924gitlab # [ 8.802586] postgresql-pre-start[797]: creating subdirectories ... ok925gitlab # [ 8.803508] postgresql-pre-start[797]: selecting dynamic shared memory implementation ... posix926gitlab # [ 8.804872] redis-server[796]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo927gitlab # [ 8.805971] redis-server[796]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=796, just started928gitlab # [ 8.807443] redis-server[796]: Configuration loaded929gitlab # [ 8.808360] redis[796]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 8.809458] redis[796]: Running mode=standalone, port=0.931gitlab # [ 8.810406] redis[796]: Server initialized932gitlab # [ 8.811232] redis[796]: Ready to accept connections unix933gitlab # [ 8.812185] redis[796]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 8.838766] postgresql-pre-start[797]: selecting default "max_connections" ... 100935gitlab # [ 8.900648] postgresql-pre-start[797]: selecting default "shared_buffers" ... 128MB936gitlab # [ 9.207155] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.428529] postgresql-pre-start[797]: selecting default time zone ... UTC938gitlab # [ 9.430600] postgresql-pre-start[797]: creating configuration files ... ok939gitlab # [ 9.662847] postgresql-pre-start[797]: running bootstrap script ... ok940gitlab # [ 9.683903] gitlab-workhorse[821]: time="2026-09-01T10:31:40Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4941gitlab # [ 9.685896] gitlab-workhorse[821]: time="2026-09-01T10:31:40Z" level=info msg="Using redis/go-redis"942gitlab # [ 9.687182] gitlab-workhorse[821]: time="2026-09-01T10:31:40Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix943gitlab # [ 10.277057] dhcpcd[761]: eth0: soliciting a DHCP lease944gitlab # [ 10.292737] dhcpcd[761]: eth0: offered 10.0.2.15 from 10.0.2.2945gitlab # [ 10.316697] dhcpcd[761]: eth0: probing address 10.0.2.15/24946gitlab # [ 10.376753] postgresql-pre-start[797]: performing post-bootstrap initialization ... ok947gitlab # [ 10.454033] dhcpcd[761]: eth0: soliciting an IPv6 router948gitlab # [ 10.457172] dhcpcd[761]: eth0: Router Advertisement from fe80::2949gitlab # [ 10.459460] dhcpcd[761]: eth0: adding address fec0::5054:ff:fe12:3456/64950gitlab # [ 10.462002] dhcpcd[761]: eth0: adding route to fec0::/64951gitlab # [ 10.464084] dhcpcd[761]: eth0: adding default route via fe80::2952gitlab # [ 10.688412] postgresql-pre-start[797]: syncing data to disk ... ok953gitlab # [ 10.691130] postgresql-pre-start[797]: initdb: warning: enabling "trust" authentication for local connections954gitlab # [ 10.695213] postgresql-pre-start[797]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.955gitlab # [ 10.701593] postgresql-pre-start[797]: Success. You can now start the database server using:956gitlab # [ 10.705077] postgresql-pre-start[797]: pg_ctl -D /var/lib/postgresql/18 -l logfile start957gitlab # [ 10.874099] postgres[855]: [855] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 10.879728] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 10.883071] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 10.886659] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 10.894037] postgres[864]: [864] LOG: database system was shut down at 2026-09-01 10:31:41 GMT962gitlab # [ 10.906889] postgres[855]: [855] LOG: database system is ready to accept connections963gitlab # [ 10.911854] systemd[1]: Started PostgreSQL Server.964gitlab # [ 10.920569] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 11.150279] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: mkdir -p /var/gitlab/state/home/.ssh: OK966gitlab # [ 11.155025] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: chmod 700 /var/gitlab/state/home/.ssh: OK967gitlab # [ 11.246536] systemd[1]: Finished gitlab-config.service.968gitlab # [ 11.253255] systemd[1]: Started gitaly.service.969gitlab # [ 11.255370] postgresql-setup-start[880]: CREATE DATABASE970gitlab # [ 11.297259] postgresql-setup-start[898]: CREATE ROLE971gitlab # [ 11.330760] postgresql-setup-start[901]: ALTER DATABASE972gitlab # [ 11.385448] postgresql-setup-start[906]: CREATE ROLE973gitlab # [ 11.390027] systemd[1]: Finished PostgreSQL Setup Scripts.974gitlab # [ 11.392879] systemd[1]: Reached target PostgreSQL.975gitlab # [ 11.397095] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 11.404538] systemd[1]: Starting gitlab-postgresql.service...977gitlab # [ 11.624336] gitlab-postgresql-start[925]: CREATE DATABASE978gitlab # [ 11.677763] gitlab-postgresql-start[935]: CREATE EXTENSION979gitlab # [ 11.799813] gitlab-postgresql-start[937]: CREATE EXTENSION980gitlab # [ 11.805476] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 12.114931] gitaly[894]: time="2026-09-01T10:31:42.888Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=894982gitlab # [ 12.136302] gitaly[894]: time="2026-09-01T10:31:42.888Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=894983gitlab # [ 12.140692] gitaly[894]: time="2026-09-01T10:31:42.888Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=894984gitlab # [ 12.146039] gitaly[894]: time="2026-09-01T10:31:42.888Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=894985gitlab # [ 12.150514] gitaly[894]: time="2026-09-01T10:31:42.888Z" level=info msg="Starting Gitaly" pid=894 version=986gitlab # [ 12.373266] gitaly[894]: time="2026-09-01T10:31:43.147Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=258 pid=894987gitlab # [ 12.375092] gitaly[894]: time="2026-09-01T10:31:43.147Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=894988gitlab # [ 12.376736] gitaly[894]: time="2026-09-01T10:31:43.148Z" level=info msg="finished initializing command factory" duration_ms=0 pid=894989gitlab # [ 12.378336] gitaly[894]: time="2026-09-01T10:31:43.148Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-894/git-exec-3063942779.d/git pid=894990gitlab # [ 12.382566] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="finished detecting git version" duration_ms=8 pid=894991gitlab # [ 12.384210] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="using Git version" pid=894 version=2.53.g992gitlab # [ 12.385726] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="clearing disk cache object folder" pid=894 storage=default993gitlab # [ 12.387375] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2553449006 pid=894 storage=default994gitlab # [ 12.390230] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2553449006 pid=894 storage=default995gitlab # [ 12.393195] gitaly[894]: time="2026-09-01T10:31:43.157Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=894996gitlab # [ 12.396046] gitaly[894]: time="2026-09-01T10:31:43.158Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=894997gitlab # [ 12.398882] gitaly[894]: time="2026-09-01T10:31:43.158Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2553449006 clear_duration_ms=0 pid=894 storage=default998gitlab # [ 12.402018] gitaly[894]: time="2026-09-01T10:31:43.174Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=894999gitlab # [ 12.404469] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=894 schema=unix1000gitlab # [ 12.406510] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="finished tempdir cleaner walk" pid=894 storage=default time_ms=01001gitlab # [ 12.408335] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="listening at address" address=/run/gitaly/gitaly-894/sock.d/intern pid=894 schema=unix1002gitlab # [ 12.410436] gitaly[894]: time="2026-09-01T10:31:43.174Z" level=info msg="counting repositories" pid=8941003gitlab # [ 12.411869] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="starting to count repositories" pid=894 storage_path=/var/gitlab/state/repositories1004gitlab # [ 12.414090] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=894 storage_path=/var/gitlab/state/repositories1005gitlab # [ 12.416316] gitaly[894]: time="2026-09-01T10:31:43.175Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8941006gitlab # [ 12.418035] gitaly[894]: time="2026-09-01T10:31:43.179Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8941007gitlab # [ 12.419795] gitaly[894]: time="2026-09-01T10:31:43.179Z" level=info msg="Started Gitaly" duration_ms=291 pid=8941008gitlab # [ 12.421387] gitaly[894]: time="2026-09-01T10:31:43.179Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8941009gitlab # [ 12.423184] gitaly[894]: time="2026-09-01T10:31:43.180Z" level=info msg="maintenance: daily scheduled" pid=894 scheduled="2026-09-01 12:00:00 +0000 UTC"1010gitlab # [ 13.226892] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 13.227537] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 13.259898] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 15.723802] dhcpcd[761]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 15.724254] dhcpcd[761]: eth0: adding route to 10.0.2.0/241015gitlab # [ 15.724411] dhcpcd[761]: eth0: adding default route via 10.0.2.21016gitlab # [ 15.782668] gitaly[894]: time="2026-09-01T10:31:46.556Z" level=info msg="License database preloaded" duration_ms=3629 pid=8941017gitlab # [ 15.882926] systemd[1]: Started DHCP Client.1018gitlab # [ 15.884977] systemd[1]: Reached target Network is Online.1019gitlab # [ 59.773958] gitlab-workhorse[821]: time="2026-09-01T10:32:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1020gitlab # [ 59.850935] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: W, [2026-09-01T10:32:30.624390 #915] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1021gitlab # [ 63.132654] postgres[1456]: [1456] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 63.134015] postgres[1456]: [1456] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 63.135161] postgres[1456]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 63.136450] postgres[1456]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 63.137577] postgres[1456]: attidentity AS identity,1026gitlab # [ 63.138325] postgres[1456]: attgenerated as attgenerated1027gitlab # [ 63.139114] postgres[1456]: FROM pg_attribute a1028gitlab # [ 63.139763] postgres[1456]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 63.140962] postgres[1456]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 63.141843] postgres[1456]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 63.143179] postgres[1456]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 63.144112] postgres[1456]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 63.144971] postgres[1456]: ORDER BY a.attnum1034gitlab # [ 63.145601] postgres[1456]:1035gitlab # [ 68.524687] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1507]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 68.528512] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1507]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.783331] gitlab-workhorse[821]: time="2026-09-01T10:32:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.785522] gitlab-workhorse[821]: time="2026-09-01T10:32:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.786635] gitlab-workhorse[821]: time="2026-09-01T10:33:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 95.064432] postgres[1610]: [1610] ERROR: relation "table_without_models" does not exist1041gitlab # [ 95.064941] postgres[1610]: [1610] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.794078] gitlab-workhorse[821]: time="2026-09-01T10:33:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.795102] gitlab-workhorse[821]: time="2026-09-01T10:33:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.802394] gitlab-workhorse[821]: time="2026-09-01T10:33:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 125.501760] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 125.507849] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 125.513763] systemd[1]: Starting gitlab.service...1048gitlab # [ 126.114538] bundle[1994]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 126.120923] bundle[1994]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 126.130870] bundle[1994]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 129.805913] gitlab-workhorse[821]: time="2026-09-01T10:33:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052gitlab # [ 130.966882] sidekiq-cluster[1993]: {"severity":"INFO","time":"2026-09-01T10:33:41.711Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 131.064072] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.805Z","pid":1994,"message":"* Enabling systemd notification integration"}1054gitlab # [ 131.069546] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"Puma starting in cluster mode..."}1055gitlab # [ 131.074111] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 131.079051] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 131.084872] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Min threads: 0"}1058gitlab # [ 131.088686] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Max threads: 4"}1059gitlab # [ 131.092733] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Environment: production"}1060gitlab # [ 131.097020] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Master PID: 1994"}1061gitlab # [ 131.100934] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Workers: 2"}1062gitlab # [ 131.104739] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 131.109623] bundle[1994]: {"timestamp":"2026-09-01T10:33:41.837Z","pid":1994,"message":"* Preloading application"}1064gitlab # [ 139.807944] gitlab-workhorse[821]: time="2026-09-01T10:33:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.811029] gitlab-workhorse[821]: time="2026-09-01T10:34:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.818217] gitlab-workhorse[821]: time="2026-09-01T10:34:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 169.826273] gitlab-workhorse[821]: time="2026-09-01T10:34:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 170.695156] bundle[1994]: W, [2026-09-01T10:34:21.468413 #1994] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 176.811538] sidekiq-cluster[2044]: 2026-09-01T10:34:27.584Z pid=2044 tid=wno INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2044, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433311744}1070gitlab # [ 177.137021] sidekiq-cluster[2044]: W, [2026-09-01T10:34:27.911249 #2044] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1071gitlab # [ 177.211348] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:27.985Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1072gitlab # [ 179.836130] gitlab-workhorse[821]: time="2026-09-01T10:34:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1073gitlab # [ 181.341804] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.114Z","message":"GitLab reliable fetch activated!"}1074gitlab # [ 181.342173] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.115Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1075gitlab # [ 181.377753] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.152Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1076gitlab # [ 181.385890] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.154Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1077gitlab # [ 181.392910] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.157Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1078gitlab # [ 181.399448] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.160Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1079gitlab # [ 181.406890] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.163Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1080gitlab # [ 181.413620] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.166Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1081gitlab # [ 181.420054] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.168Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1082gitlab # [ 181.425462] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.170Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1083gitlab # [ 181.430194] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.173Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1084gitlab # [ 181.434817] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.175Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1085gitlab # [ 181.439733] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.177Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1086gitlab # [ 181.444208] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.179Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1087gitlab # [ 181.447826] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.182Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1088gitlab # [ 181.451765] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.184Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1089gitlab # [ 181.455442] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.186Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1090gitlab # [ 181.458964] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.188Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1091gitlab # [ 181.462168] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.191Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1092gitlab # [ 181.465107] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.194Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1093gitlab # [ 181.468208] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.197Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1094gitlab # [ 181.471055] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.200Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1095gitlab # [ 181.474279] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.203Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1096gitlab # [ 181.477579] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.205Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1097gitlab # [ 181.480181] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.208Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1098gitlab # [ 181.482814] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.210Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1099gitlab # [ 181.486101] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.212Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1100gitlab # [ 181.488831] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.216Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1101gitlab # [ 181.491376] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.219Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1102gitlab # [ 181.494169] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.222Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1103gitlab # [ 181.496969] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.225Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1104gitlab # [ 181.499700] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.228Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1105gitlab # [ 181.502421] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.230Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1106gitlab # [ 181.505357] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.233Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1107gitlab # [ 181.507888] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.236Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1108gitlab # [ 181.510803] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.239Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1109gitlab # [ 181.513544] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.241Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1110gitlab # [ 181.516258] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.243Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1111gitlab # [ 181.519010] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.246Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1112gitlab # [ 181.521679] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.249Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1113gitlab # [ 181.524534] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.251Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1114gitlab # [ 181.527298] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.258Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1115gitlab # [ 181.530210] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.266Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1116gitlab # [ 181.532938] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.269Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1117gitlab # [ 181.535525] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.271Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1118gitlab # [ 181.538126] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.273Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1119gitlab # [ 181.540720] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.276Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1120gitlab # [ 181.543227] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.278Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1121gitlab # [ 181.545708] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.280Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1122gitlab # [ 181.548048] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.282Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1123gitlab # [ 181.550254] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.284Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1124gitlab # [ 181.552532] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.286Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1125gitlab # [ 181.554746] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.289Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1126gitlab # [ 181.556992] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.292Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1127gitlab # [ 181.559138] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.301Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1128gitlab # [ 181.561597] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.304Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1129gitlab # [ 181.563717] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.306Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1130gitlab # [ 181.565991] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.309Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1131gitlab # [ 181.568145] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.312Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1132gitlab # [ 181.570542] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.314Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1133gitlab # [ 181.572793] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.316Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1134gitlab # [ 181.575011] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.318Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1135gitlab # [ 181.577098] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.320Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1136gitlab # [ 181.579080] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.322Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1137gitlab # [ 181.581286] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.324Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1138gitlab # [ 181.583438] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.327Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1139gitlab # [ 181.585964] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.330Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1140gitlab # [ 181.588115] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.332Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1141gitlab # [ 181.591327] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.334Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1142gitlab # [ 181.593572] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.336Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1143gitlab # [ 181.595807] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.338Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1144gitlab # [ 181.598221] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.340Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1145gitlab # [ 181.600437] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.341Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1146gitlab # [ 181.602685] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.343Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1147gitlab # [ 181.604950] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.345Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1148gitlab # [ 181.607243] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.346Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1149gitlab # [ 181.609644] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.349Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1150gitlab # [ 181.611937] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.350Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1151gitlab # [ 181.614268] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.352Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1152gitlab # [ 181.616733] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.354Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 181.618869] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.356Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1154gitlab # [ 181.621045] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.358Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1155gitlab # [ 181.623323] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.359Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1156gitlab # [ 181.625791] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.361Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1157gitlab # [ 181.628073] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.364Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1158gitlab # [ 181.630238] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.365Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1159gitlab # [ 181.632575] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.368Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1160gitlab # [ 181.634734] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.370Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1161gitlab # [ 181.637095] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.372Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1162gitlab # [ 181.639285] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.374Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1163gitlab # [ 181.641645] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.376Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1164gitlab # [ 181.643828] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.377Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1165gitlab # [ 181.646206] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.379Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1166gitlab # [ 181.648433] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.381Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1167gitlab # [ 181.650635] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.382Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1168gitlab # [ 181.653083] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.384Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1169gitlab # [ 181.655065] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.387Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1170gitlab # [ 181.657484] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.389Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1171gitlab # [ 181.659707] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.391Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1172gitlab # [ 181.662069] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.392Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1173gitlab # [ 181.664415] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.402Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1174gitlab # [ 181.666596] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.404Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1175gitlab # [ 181.668815] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.406Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1176gitlab # [ 181.671003] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.409Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1177gitlab # [ 181.673099] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.411Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1178gitlab # [ 181.675227] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.414Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1179gitlab # [ 181.677610] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.416Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1180gitlab # [ 181.679839] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.418Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1181gitlab # [ 181.682032] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.420Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1182gitlab # [ 181.684205] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.423Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1183gitlab # [ 181.686340] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:34:32.424Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1184gitlab # [ 189.837372] gitlab-workhorse[821]: time="2026-09-01T10:34:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.846180] gitlab-workhorse[821]: time="2026-09-01T10:34:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.859337] gitlab-workhorse[821]: time="2026-09-01T10:35:00Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 219.867037] gitlab-workhorse[821]: time="2026-09-01T10:35:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 229.877592] gitlab-workhorse[821]: time="2026-09-01T10:35:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 232.421228] postgres[2889]: [2889] ERROR: relation "table_without_models" does not exist1190gitlab # [ 232.425069] postgres[2889]: [2889] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 233.690390] postgres[2900]: [2900] ERROR: relation "table_without_models" does not exist1192gitlab # [ 233.690753] postgres[2900]: [2900] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1193gitlab # [ 237.667070] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:28.440Z","message":"Booted Rails 7.2.3.1 application in production environment"}1194gitlab # [ 237.670254] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:28.443Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1195gitlab # [ 237.672631] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:28.444Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1196gitlab # [ 237.680301] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:28.444Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1197gitlab # [ 237.682459] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:28.450Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1198gitlab # [ 239.787633] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.561Z","pid":1994,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1199gitlab # [ 239.790361] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.564Z","pid":1994,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1200gitlab # [ 239.794324] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.567Z","pid":1994,"message":"! #\u003cThread:0x0000f216943ae768 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1201gitlab # [ 239.804630] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.567Z","pid":1994,"message":"! #\u003cThread:0x0000f216945bb718 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1202gitlab # [ 239.811027] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.568Z","pid":1994,"message":"Use Ctrl-C to stop"}1203gitlab # [ 239.812612] bundle[1994]: {"timestamp":"2026-09-01T10:35:30.578Z","pid":1994,"message":"Sending status to systemd every 1.0 sec"}1204gitlab # [ 240.832888] bundle[1994]: {"timestamp":"2026-09-01T10:35:31.606Z","pid":1994,"message":"- Worker 0 (PID: 3011) booted in 0.95s, phase: 0"}1205gitlab # [ 240.917938] bundle[1994]: {"timestamp":"2026-09-01T10:35:31.692Z","pid":1994,"message":"- Worker 1 (PID: 3015) booted in 0.99s, phase: 0"}1206gitlab # [ 240.925942] systemd[1]: Started gitlab.service.1207gitlab # [ 240.927243] systemd[1]: Reached target Common target for all GitLab services..1208gitlab # [ 240.936222] systemd[1]: Starting setup-gitlab.service...1209gitlab # [ 240.977838] setup-gitlab-start[3051]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1210gitlab # [ 241.589833] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:32.363Z","message":"Cleaning working queues"}1211gitlab # [ 241.598841] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:32.372Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"24a97e5648530869876f74e1","created_at":"2026-09-01T10:33:35.545Z","trace_propagation_headers":{"sentry-trace":"837d6d7321694635aacf6fdc5c2dbe15-ddac78d5a81f4ef9","baggage":"sentry-trace_id=837d6d7321694635aacf6fdc5c2dbe15,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5ea45c255e58dea61c99f0299778ff53","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:33:35.557Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-24a97e5648530869876f74e1: start","job_status":"start","queue_duration_s":116.814894,"scheduling_latency_s":116.815014}1212gitlab # [ 241.948217] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:32.721Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"24a97e5648530869876f74e1","created_at":"2026-09-01T10:33:35.545Z","trace_propagation_headers":{"sentry-trace":"837d6d7321694635aacf6fdc5c2dbe15-ddac78d5a81f4ef9","baggage":"sentry-trace_id=837d6d7321694635aacf6fdc5c2dbe15,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5ea45c255e58dea61c99f0299778ff53","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:33:35.557Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-24a97e5648530869876f74e1: done: 0.349153 sec","job_status":"done","queue_duration_s":116.814894,"scheduling_latency_s":116.815014,"redis_calls":24,"redis_duration_s":0.013427999999999999,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005077,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004587,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003764,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.169798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18053282,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.349153,"completed_at":"2026-09-01T10:35:32.721Z","load_balancing_strategy":"primary","db_duration_s":0.08711,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1213gitlab # [ 247.283545] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:35:38 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 62581214gitlab # [ 247.291533] setup-gitlab-start[3051]: + TOKEN=nixbot-test-token-of-20-chars1215gitlab # [ 247.295399] setup-gitlab-start[3051]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1216gitlab # [ 247.321196] runuser[3093]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1217gitlab # [ 248.267542] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 248.274465] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 248.281468] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 249.739550] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1221gitlab # [ 249.746998] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1222gitlab # [ 249.753950] setup-gitlab-start[3094]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1223gitlab # [ 252.168322] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:42.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c62014e5931a2b186b45d4c1","created_at":"2026-09-01T10:35:42.790Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c2aa9a7acf17f066886a94087773b9c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:42.923Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c62014e5931a2b186b45d4c1: start","job_status":"start","queue_duration_s":0.014742,"scheduling_latency_s":0.015024}1224gitlab # [ 254.032627] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c62014e5931a2b186b45d4c1","created_at":"2026-09-01T10:35:42.790Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c2aa9a7acf17f066886a94087773b9c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:42.923Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c62014e5931a2b186b45d4c1: done: 1.867447 sec","job_status":"done","queue_duration_s":0.014742,"scheduling_latency_s":0.015024,"redis_calls":565,"redis_duration_s":1.010528,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.997573,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.845132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053346,"duration_s":1.867447,"completed_at":"2026-09-01T10:35:44.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 254.033381] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"558371c9067a2219937da525","created_at":"2026-09-01T10:35:43.004Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05662b54f3e6fb77543521c38ddc3ec8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.048Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-558371c9067a2219937da525: start","job_status":"start","queue_duration_s":1.75902,"scheduling_latency_s":1.75905}1226gitlab # [ 254.134753] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.824Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1227gitlab # [ 254.134956] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"558371c9067a2219937da525","created_at":"2026-09-01T10:35:43.004Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05662b54f3e6fb77543521c38ddc3ec8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.048Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-558371c9067a2219937da525: done: 0.02656 sec","job_status":"done","queue_duration_s":1.75902,"scheduling_latency_s":1.75905,"redis_calls":10,"redis_duration_s":0.002842,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000618,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037696,"duration_s":0.02656,"completed_at":"2026-09-01T10:35:44.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 254.852213] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48f9737e25f1cdb18b6972c1","created_at":"2026-09-01T10:35:43.074Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4fff1b5e2268999dc6df8d23c74fc0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.090Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48f9737e25f1cdb18b6972c1: start","job_status":"start","queue_duration_s":1.746321,"scheduling_latency_s":1.746346}1229gitlab # [ 254.852352] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.854Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1230gitlab # [ 254.852568] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48f9737e25f1cdb18b6972c1","created_at":"2026-09-01T10:35:43.074Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4fff1b5e2268999dc6df8d23c74fc0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.090Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48f9737e25f1cdb18b6972c1: done: 0.02751 sec","job_status":"done","queue_duration_s":1.746321,"scheduling_latency_s":1.746346,"redis_calls":10,"redis_duration_s":0.003333,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000947,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039762,"duration_s":0.02751,"completed_at":"2026-09-01T10:35:44.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 255.456609] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"87cdae2fa5615b6430c0d35b","created_at":"2026-09-01T10:35:43.102Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c826f524cbca6d80fa848675322bf20","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.122Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-87cdae2fa5615b6430c0d35b: start","job_status":"start","queue_duration_s":1.743546,"scheduling_latency_s":1.743574}1232gitlab # [ 255.456834] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"87cdae2fa5615b6430c0d35b","created_at":"2026-09-01T10:35:43.102Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c826f524cbca6d80fa848675322bf20","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.122Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-87cdae2fa5615b6430c0d35b: done: 0.071324 sec","job_status":"done","queue_duration_s":1.743546,"scheduling_latency_s":1.743574,"redis_calls":10,"redis_duration_s":0.0036629999999999996,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000803,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005693,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.071324,"completed_at":"2026-09-01T10:35:44.937Z","load_balancing_strategy":"primary","db_duration_s":0.03606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 256.184053] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2005b78a13bb9b6e34af887f","created_at":"2026-09-01T10:35:43.139Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab486c76af8e24ce7f9cc5d8120836ff","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.168Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2005b78a13bb9b6e34af887f: start","job_status":"start","queue_duration_s":1.772039,"scheduling_latency_s":1.772076}1234gitlab # [ 256.856832] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2005b78a13bb9b6e34af887f","created_at":"2026-09-01T10:35:43.139Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab486c76af8e24ce7f9cc5d8120836ff","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.168Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2005b78a13bb9b6e34af887f: done: 0.040042 sec","job_status":"done","queue_duration_s":1.772039,"scheduling_latency_s":1.772076,"redis_calls":12,"redis_duration_s":0.004261,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000787,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009327,"exclusive_lock_hold_duration_s":0.00688002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.040042,"completed_at":"2026-09-01T10:35:44.980Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 257.475374] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:44.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"84c5088de4d6f2ba1f21c32d","created_at":"2026-09-01T10:35:43.178Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87258bb6b9bff6b9fe79fd69c7bd5e0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.205Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-84c5088de4d6f2ba1f21c32d: start","job_status":"start","queue_duration_s":1.777599,"scheduling_latency_s":1.777628}1236gitlab # [ 257.475637] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"84c5088de4d6f2ba1f21c32d","created_at":"2026-09-01T10:35:43.178Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87258bb6b9bff6b9fe79fd69c7bd5e0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.205Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-84c5088de4d6f2ba1f21c32d: done: 0.043157 sec","job_status":"done","queue_duration_s":1.777599,"scheduling_latency_s":1.777628,"redis_calls":12,"redis_duration_s":0.003968,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000682,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073024,"exclusive_lock_hold_duration_s":0.01402374,"duration_s":0.043157,"completed_at":"2026-09-01T10:35:45.026Z","load_balancing_strategy":"primary","db_duration_s":0.00708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 258.180267] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6f5b92a5b1dd3cfadd1cd68c","created_at":"2026-09-01T10:35:43.226Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28156085af53ab77195a892044372659","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:35:43.243Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6f5b92a5b1dd3cfadd1cd68c: start","job_status":"start","queue_duration_s":1.785728,"scheduling_latency_s":1.785753}1238gitlab # [ 258.180378] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.045Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1239gitlab # [ 258.180550] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6f5b92a5b1dd3cfadd1cd68c","created_at":"2026-09-01T10:35:43.226Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28156085af53ab77195a892044372659","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:35:43.243Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6f5b92a5b1dd3cfadd1cd68c: done: 0.026005 sec","job_status":"done","queue_duration_s":1.785728,"scheduling_latency_s":1.785753,"redis_calls":10,"redis_duration_s":0.003214,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054488,"duration_s":0.026005,"completed_at":"2026-09-01T10:35:45.054Z","load_balancing_strategy":"primary","db_duration_s":0.001044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 258.902583] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5172a1e908246cdf3cbcab0f","created_at":"2026-09-01T10:35:43.265Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.285Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5172a1e908246cdf3cbcab0f: start","job_status":"start","queue_duration_s":1.771927,"scheduling_latency_s":1.77195}1241gitlab # [ 258.902847] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5172a1e908246cdf3cbcab0f","created_at":"2026-09-01T10:35:43.265Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.285Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5172a1e908246cdf3cbcab0f: done: 0.137268 sec","job_status":"done","queue_duration_s":1.771927,"scheduling_latency_s":1.77195,"redis_calls":71,"redis_duration_s":0.021759999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003119,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001607,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016072,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004398,"duration_s":0.137268,"completed_at":"2026-09-01T10:35:45.194Z","load_balancing_strategy":"primary","db_duration_s":0.003412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 259.626092] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"80934b6f594fcaf39df8749e","created_at":"2026-09-01T10:35:43.305Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e52a68de9cbf445c391803d82a7b9a0d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.334Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-80934b6f594fcaf39df8749e: start","job_status":"start","queue_duration_s":1.861732,"scheduling_latency_s":1.861761}1243gitlab # [ 260.280534] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"80934b6f594fcaf39df8749e","created_at":"2026-09-01T10:35:43.305Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e52a68de9cbf445c391803d82a7b9a0d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.334Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-80934b6f594fcaf39df8749e: done: 0.052577 sec","job_status":"done","queue_duration_s":1.861732,"scheduling_latency_s":1.861761,"redis_calls":13,"redis_duration_s":0.003797,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001817,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01705824,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.052577,"completed_at":"2026-09-01T10:35:45.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007078,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1244gitlab # [ 261.002831] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"082d75716f4fe28d6bb8e1b4","created_at":"2026-09-01T10:35:43.356Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e22a2bde6e9f6158c80269ab212f3a5b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.377Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-082d75716f4fe28d6bb8e1b4: start","job_status":"start","queue_duration_s":1.874123,"scheduling_latency_s":1.87415}1245gitlab # [ 261.003090] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"082d75716f4fe28d6bb8e1b4","created_at":"2026-09-01T10:35:43.356Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e22a2bde6e9f6158c80269ab212f3a5b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.377Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-082d75716f4fe28d6bb8e1b4: done: 0.050747 sec","job_status":"done","queue_duration_s":1.874123,"scheduling_latency_s":1.87415,"redis_calls":10,"redis_duration_s":0.0032849999999999997,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006162,"duration_s":0.050747,"completed_at":"2026-09-01T10:35:45.302Z","load_balancing_strategy":"primary","db_duration_s":0.011442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 261.722815] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"313557cd2ac12aaa93cb4a30","created_at":"2026-09-01T10:35:43.408Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bd4bec2ac1a0bb7765f4e9d308060f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:35:43.435Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-313557cd2ac12aaa93cb4a30: start","job_status":"start","queue_duration_s":1.868577,"scheduling_latency_s":1.868603}1247gitlab # [ 261.723121] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"313557cd2ac12aaa93cb4a30","created_at":"2026-09-01T10:35:43.408Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bd4bec2ac1a0bb7765f4e9d308060f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:35:43.435Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-313557cd2ac12aaa93cb4a30: done: 0.047972 sec","job_status":"done","queue_duration_s":1.868577,"scheduling_latency_s":1.868603,"redis_calls":10,"redis_duration_s":0.0033049999999999998,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000557,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063086,"duration_s":0.047972,"completed_at":"2026-09-01T10:35:45.352Z","load_balancing_strategy":"primary","db_duration_s":0.0095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 262.396825] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7b7c1ed8c4b473af61274758","created_at":"2026-09-01T10:35:43.491Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b09b97ac3896ab7f3feec987ea0ea32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.539Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7b7c1ed8c4b473af61274758: start","job_status":"start","queue_duration_s":1.815901,"scheduling_latency_s":1.815927}1249gitlab # [ 262.397067] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7b7c1ed8c4b473af61274758","created_at":"2026-09-01T10:35:43.491Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b09b97ac3896ab7f3feec987ea0ea32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.539Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7b7c1ed8c4b473af61274758: done: 0.375514 sec","job_status":"done","queue_duration_s":1.815901,"scheduling_latency_s":1.815927,"redis_calls":14,"redis_duration_s":0.011581,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003316,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006043,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.065,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.275766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0053673,"exclusive_lock_hold_duration_s":0.33259084,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.375514,"completed_at":"2026-09-01T10:35:45.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.099373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 263.122967] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2a58952607c4ea1f1864b5ec","created_at":"2026-09-01T10:35:43.571Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24d743d4f7ec899e3e897dbb44d5956d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.599Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2a58952607c4ea1f1864b5ec: start","job_status":"start","queue_duration_s":2.134007,"scheduling_latency_s":2.134031}1251gitlab # [ 263.848190] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2a58952607c4ea1f1864b5ec","created_at":"2026-09-01T10:35:43.571Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24d743d4f7ec899e3e897dbb44d5956d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.599Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2a58952607c4ea1f1864b5ec: done: 0.083139 sec","job_status":"done","queue_duration_s":2.134007,"scheduling_latency_s":2.134031,"redis_calls":12,"redis_duration_s":0.004338,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000751,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001087,"exclusive_lock_hold_duration_s":0.027780640000000002,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.083139,"completed_at":"2026-09-01T10:35:45.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 264.571056] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"62b3df253831ab1cac8b2f6f","created_at":"2026-09-01T10:35:43.643Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc059340497c8dfbd9c1a98b65acb41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.681Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-62b3df253831ab1cac8b2f6f: start","job_status":"start","queue_duration_s":2.138016,"scheduling_latency_s":2.138045}1253gitlab # [ 264.571337] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.850Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"62b3df253831ab1cac8b2f6f","created_at":"2026-09-01T10:35:43.643Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc059340497c8dfbd9c1a98b65acb41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.681Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-62b3df253831ab1cac8b2f6f: done: 0.031827 sec","job_status":"done","queue_duration_s":2.138016,"scheduling_latency_s":2.138045,"redis_calls":12,"redis_duration_s":0.004276,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001926,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043656,"duration_s":0.031827,"completed_at":"2026-09-01T10:35:45.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 265.296132] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:45.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"585b291f823e7fcd4457d38c","created_at":"2026-09-01T10:35:43.732Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12375a55ea45b75134fc0bdcc183eaac","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.804Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-585b291f823e7fcd4457d38c: start","job_status":"start","queue_duration_s":2.048454,"scheduling_latency_s":2.048474}1255gitlab # [ 265.296394] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"585b291f823e7fcd4457d38c","created_at":"2026-09-01T10:35:43.732Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12375a55ea45b75134fc0bdcc183eaac","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.804Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-585b291f823e7fcd4457d38c: done: 0.208188 sec","job_status":"done","queue_duration_s":2.048454,"scheduling_latency_s":2.048474,"redis_calls":12,"redis_duration_s":0.003549,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063696,"exclusive_lock_hold_duration_s":0.18481196,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.208188,"completed_at":"2026-09-01T10:35:46.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024182,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1256gitlab # [ 265.946038] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e41939b0fac8ceb86aaf801c","created_at":"2026-09-01T10:35:43.921Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.985Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e41939b0fac8ceb86aaf801c: start","job_status":"start","queue_duration_s":2.07706,"scheduling_latency_s":2.07708}1257gitlab # [ 265.946296] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e41939b0fac8ceb86aaf801c","created_at":"2026-09-01T10:35:43.921Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:43.985Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e41939b0fac8ceb86aaf801c: done: 0.04191 sec","job_status":"done","queue_duration_s":2.07706,"scheduling_latency_s":2.07708,"redis_calls":19,"redis_duration_s":0.005215,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001293,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000343,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002669,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033552,"duration_s":0.04191,"completed_at":"2026-09-01T10:35:46.104Z","load_balancing_strategy":"primary","db_duration_s":0.003698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 266.670329] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f13fbd2f903a47a9b213ec75","created_at":"2026-09-01T10:35:44.009Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"223495f90cc7f32ab565bb1ad3d99840","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.021Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f13fbd2f903a47a9b213ec75: start","job_status":"start","queue_duration_s":2.084495,"scheduling_latency_s":2.084514}1259gitlab # [ 267.392519] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f13fbd2f903a47a9b213ec75","created_at":"2026-09-01T10:35:44.009Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"223495f90cc7f32ab565bb1ad3d99840","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.021Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f13fbd2f903a47a9b213ec75: done: 0.050956 sec","job_status":"done","queue_duration_s":2.084495,"scheduling_latency_s":2.084514,"redis_calls":12,"redis_duration_s":0.002691,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063308,"exclusive_lock_hold_duration_s":0.02895912,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.050956,"completed_at":"2026-09-01T10:35:46.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 268.103566] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6cc015ae51d8cb7444ab22eb","created_at":"2026-09-01T10:35:44.049Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d02a35827dec72a960069b9a25ecfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.066Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6cc015ae51d8cb7444ab22eb: start","job_status":"start","queue_duration_s":2.09284,"scheduling_latency_s":2.092862}1261gitlab # [ 268.103830] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6cc015ae51d8cb7444ab22eb","created_at":"2026-09-01T10:35:44.049Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d02a35827dec72a960069b9a25ecfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.066Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6cc015ae51d8cb7444ab22eb: done: 0.020922 sec","job_status":"done","queue_duration_s":2.09284,"scheduling_latency_s":2.092862,"redis_calls":10,"redis_duration_s":0.001433,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025206,"duration_s":0.020922,"completed_at":"2026-09-01T10:35:46.179Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 268.824660] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b9c8e75579ad6cf29ed955a8","created_at":"2026-09-01T10:35:44.101Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9092f0fbdf2801f0e4b2032c168016e2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.118Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b9c8e75579ad6cf29ed955a8: start","job_status":"start","queue_duration_s":2.062937,"scheduling_latency_s":2.062955}1263gitlab # [ 268.824959] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b9c8e75579ad6cf29ed955a8","created_at":"2026-09-01T10:35:44.101Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9092f0fbdf2801f0e4b2032c168016e2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.118Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b9c8e75579ad6cf29ed955a8: done: 0.028201 sec","job_status":"done","queue_duration_s":2.062937,"scheduling_latency_s":2.062955,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026046,"duration_s":0.028201,"completed_at":"2026-09-01T10:35:46.209Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 269.471012] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"5e628c509856eae851c10f4f","created_at":"2026-09-01T10:35:44.146Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"740e9ed56b4268dbae8408243fe40320","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.161Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-5e628c509856eae851c10f4f: start","job_status":"start","queue_duration_s":2.049563,"scheduling_latency_s":2.049582}1265gitlab # [ 270.208452] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"5e628c509856eae851c10f4f","created_at":"2026-09-01T10:35:44.146Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"740e9ed56b4268dbae8408243fe40320","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.161Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-5e628c509856eae851c10f4f: done: 0.029843 sec","job_status":"done","queue_duration_s":2.049563,"scheduling_latency_s":2.049582,"redis_calls":17,"redis_duration_s":0.003079,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001185,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000276,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035194,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.029843,"completed_at":"2026-09-01T10:35:46.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 270.934458] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b338de3ff210cd6f8d35d94c","created_at":"2026-09-01T10:35:44.179Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"834382eae08017f6496c05ebf2da7540","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:35:44.237Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b338de3ff210cd6f8d35d94c: start","job_status":"start","queue_duration_s":2.004378,"scheduling_latency_s":2.004395}1267gitlab # [ 270.934593] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.254Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1268gitlab # [ 270.934786] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b338de3ff210cd6f8d35d94c","created_at":"2026-09-01T10:35:44.179Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"834382eae08017f6496c05ebf2da7540","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:35:44.237Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b338de3ff210cd6f8d35d94c: done: 0.020229 sec","job_status":"done","queue_duration_s":2.004378,"scheduling_latency_s":2.004395,"redis_calls":10,"redis_duration_s":0.002521,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033362,"duration_s":0.020229,"completed_at":"2026-09-01T10:35:46.262Z","load_balancing_strategy":"primary","db_duration_s":0.000582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 271.655392] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"89358ea6c6c8246da02d98d8","created_at":"2026-09-01T10:35:44.264Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca99db98d812eaa1f169602882511a15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.303Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-89358ea6c6c8246da02d98d8: start","job_status":"start","queue_duration_s":1.961066,"scheduling_latency_s":1.961084}1270gitlab # [ 271.655554] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.276Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1271gitlab # [ 271.655759] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"89358ea6c6c8246da02d98d8","created_at":"2026-09-01T10:35:44.264Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca99db98d812eaa1f169602882511a15","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.303Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-89358ea6c6c8246da02d98d8: done: 0.020164 sec","job_status":"done","queue_duration_s":1.961066,"scheduling_latency_s":1.961084,"redis_calls":10,"redis_duration_s":0.00255,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034442,"duration_s":0.020164,"completed_at":"2026-09-01T10:35:46.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 272.326286] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f9aa7873de6e19193b9bb3b6","created_at":"2026-09-01T10:35:44.374Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2123f8af8e63155c203ffa2445284a8b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.409Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f9aa7873de6e19193b9bb3b6: start","job_status":"start","queue_duration_s":1.876538,"scheduling_latency_s":1.876556}1273gitlab # [ 272.326525] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f9aa7873de6e19193b9bb3b6","created_at":"2026-09-01T10:35:44.374Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2123f8af8e63155c203ffa2445284a8b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.409Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f9aa7873de6e19193b9bb3b6: done: 0.034821 sec","job_status":"done","queue_duration_s":1.876538,"scheduling_latency_s":1.876556,"redis_calls":10,"redis_duration_s":0.001635,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000373,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025326,"duration_s":0.034821,"completed_at":"2026-09-01T10:35:46.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 273.042541] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4529df7fd6bc2cf7abefb324","created_at":"2026-09-01T10:35:44.438Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c34048864033d75dd5ea97142974ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.471Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4529df7fd6bc2cf7abefb324: start","job_status":"start","queue_duration_s":1.851002,"scheduling_latency_s":1.851049}1275gitlab # [ 273.743195] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.336Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1276gitlab # [ 273.743460] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4529df7fd6bc2cf7abefb324","created_at":"2026-09-01T10:35:44.438Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c34048864033d75dd5ea97142974ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:35:44.471Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4529df7fd6bc2cf7abefb324: done: 0.022079 sec","job_status":"done","queue_duration_s":1.851002,"scheduling_latency_s":1.851049,"redis_calls":10,"redis_duration_s":0.001552,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002582,"duration_s":0.022079,"completed_at":"2026-09-01T10:35:46.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 274.477700] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c423972d8f11af3b142db935","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c423972d8f11af3b142db935: start","job_status":"start","queue_duration_s":1.164704,"scheduling_latency_s":1.164723}1278gitlab # [ 274.537084] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c423972d8f11af3b142db935","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c423972d8f11af3b142db935: done: 0.02429 sec","job_status":"done","queue_duration_s":1.164704,"scheduling_latency_s":1.164723,"redis_calls":16,"redis_duration_s":0.002681,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024644,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02429,"completed_at":"2026-09-01T10:35:46.370Z","load_balancing_strategy":"primary","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 274.628100] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe88f8ee55899f7c598246c","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe88f8ee55899f7c598246c: start","job_status":"start","queue_duration_s":1.190326,"scheduling_latency_s":1.190345}1280gitlab # [ 274.646988] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe88f8ee55899f7c598246c","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe88f8ee55899f7c598246c: done: 0.016625 sec","job_status":"done","queue_duration_s":1.190326,"scheduling_latency_s":1.190345,"redis_calls":13,"redis_duration_s":0.00181,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016625,"completed_at":"2026-09-01T10:35:46.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 274.691725] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1735bfbead65fccab15d8df2","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1735bfbead65fccab15d8df2: start","job_status":"start","queue_duration_s":1.208321,"scheduling_latency_s":1.20834}1282gitlab # [ 274.704383] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1735bfbead65fccab15d8df2","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1735bfbead65fccab15d8df2: done: 0.015275 sec","job_status":"done","queue_duration_s":1.208321,"scheduling_latency_s":1.20834,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015275,"completed_at":"2026-09-01T10:35:46.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 274.745237] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"901debf62bf0c8f2d710a21a","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-901debf62bf0c8f2d710a21a: start","job_status":"start","queue_duration_s":1.2249,"scheduling_latency_s":1.224919}1284gitlab # [ 274.757541] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"901debf62bf0c8f2d710a21a","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-901debf62bf0c8f2d710a21a: done: 0.015359 sec","job_status":"done","queue_duration_s":1.2249,"scheduling_latency_s":1.224919,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015359,"completed_at":"2026-09-01T10:35:46.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 274.796529] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf7cf2aefa3e892f9e3f641","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf7cf2aefa3e892f9e3f641: start","job_status":"start","queue_duration_s":1.242346,"scheduling_latency_s":1.242364}1286gitlab # [ 274.810098] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf7cf2aefa3e892f9e3f641","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf7cf2aefa3e892f9e3f641: done: 0.016722 sec","job_status":"done","queue_duration_s":1.242346,"scheduling_latency_s":1.242364,"redis_calls":13,"redis_duration_s":0.003308,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016722,"completed_at":"2026-09-01T10:35:46.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 274.848921] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f7274c3e03757ceeef545aa","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f7274c3e03757ceeef545aa: start","job_status":"start","queue_duration_s":1.260734,"scheduling_latency_s":1.260751}1288gitlab # [ 274.861277] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f7274c3e03757ceeef545aa","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f7274c3e03757ceeef545aa: done: 0.016258 sec","job_status":"done","queue_duration_s":1.260734,"scheduling_latency_s":1.260751,"redis_calls":13,"redis_duration_s":0.0029890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016258,"completed_at":"2026-09-01T10:35:46.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 274.900854] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df16c0d3570d2095841fab52","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df16c0d3570d2095841fab52: start","job_status":"start","queue_duration_s":1.278727,"scheduling_latency_s":1.278746}1290gitlab # [ 274.913375] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df16c0d3570d2095841fab52","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df16c0d3570d2095841fab52: done: 0.016172 sec","job_status":"done","queue_duration_s":1.278727,"scheduling_latency_s":1.278746,"redis_calls":13,"redis_duration_s":0.002874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016172,"completed_at":"2026-09-01T10:35:46.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 274.952628] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e527a979d28af6f033e6d76a","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e527a979d28af6f033e6d76a: start","job_status":"start","queue_duration_s":1.296297,"scheduling_latency_s":1.296314}1292gitlab # [ 274.965070] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e527a979d28af6f033e6d76a","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e527a979d28af6f033e6d76a: done: 0.016071 sec","job_status":"done","queue_duration_s":1.296297,"scheduling_latency_s":1.296314,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016071,"completed_at":"2026-09-01T10:35:46.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 275.005410] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3210876babce146c8d3ecab4","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3210876babce146c8d3ecab4: start","job_status":"start","queue_duration_s":1.31381,"scheduling_latency_s":1.313828}1294gitlab # [ 275.017622] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3210876babce146c8d3ecab4","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3210876babce146c8d3ecab4: done: 0.01617 sec","job_status":"done","queue_duration_s":1.31381,"scheduling_latency_s":1.313828,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01617,"completed_at":"2026-09-01T10:35:46.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 275.056440] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4ff3ead7891c82c72191bd","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4ff3ead7891c82c72191bd: start","job_status":"start","queue_duration_s":1.331402,"scheduling_latency_s":1.33142}1296gitlab # [ 275.068788] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4ff3ead7891c82c72191bd","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4ff3ead7891c82c72191bd: done: 0.016475 sec","job_status":"done","queue_duration_s":1.331402,"scheduling_latency_s":1.33142,"redis_calls":13,"redis_duration_s":0.00292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016475,"completed_at":"2026-09-01T10:35:46.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 275.107974] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2b5f0dc5c92c58b7b7ca70","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2b5f0dc5c92c58b7b7ca70: start","job_status":"start","queue_duration_s":1.349361,"scheduling_latency_s":1.349378}1298gitlab # [ 275.120664] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2b5f0dc5c92c58b7b7ca70","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2b5f0dc5c92c58b7b7ca70: done: 0.017659 sec","job_status":"done","queue_duration_s":1.349361,"scheduling_latency_s":1.349378,"redis_calls":13,"redis_duration_s":0.003522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017659,"completed_at":"2026-09-01T10:35:46.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 275.160226] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe97166ad3a440e623668ae8","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe97166ad3a440e623668ae8: start","job_status":"start","queue_duration_s":1.368529,"scheduling_latency_s":1.368546}1300gitlab # [ 275.172723] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe97166ad3a440e623668ae8","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe97166ad3a440e623668ae8: done: 0.016741 sec","job_status":"done","queue_duration_s":1.368529,"scheduling_latency_s":1.368546,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016741,"completed_at":"2026-09-01T10:35:46.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 275.213344] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567e4c5fbb1168b0e2c1363d","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567e4c5fbb1168b0e2c1363d: start","job_status":"start","queue_duration_s":1.386895,"scheduling_latency_s":1.386912}1302gitlab # [ 275.226100] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567e4c5fbb1168b0e2c1363d","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567e4c5fbb1168b0e2c1363d: done: 0.015927 sec","job_status":"done","queue_duration_s":1.386895,"scheduling_latency_s":1.386912,"redis_calls":13,"redis_duration_s":0.002832,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015927,"completed_at":"2026-09-01T10:35:46.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 275.265945] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1468f028776c8386582965","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1468f028776c8386582965: start","job_status":"start","queue_duration_s":1.404371,"scheduling_latency_s":1.404389}1304gitlab # [ 275.278361] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1468f028776c8386582965","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1468f028776c8386582965: done: 0.016147 sec","job_status":"done","queue_duration_s":1.404371,"scheduling_latency_s":1.404389,"redis_calls":13,"redis_duration_s":0.002986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016147,"completed_at":"2026-09-01T10:35:46.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 275.317986] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df1793f40dc101f9e3ed2cd1","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df1793f40dc101f9e3ed2cd1: start","job_status":"start","queue_duration_s":1.42204,"scheduling_latency_s":1.422057}1306gitlab # [ 275.330626] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df1793f40dc101f9e3ed2cd1","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df1793f40dc101f9e3ed2cd1: done: 0.015872 sec","job_status":"done","queue_duration_s":1.42204,"scheduling_latency_s":1.422057,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015872,"completed_at":"2026-09-01T10:35:46.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 275.370222] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6a3de9bb953687a0000d822","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6a3de9bb953687a0000d822: start","job_status":"start","queue_duration_s":1.439535,"scheduling_latency_s":1.439552}1308gitlab # [ 275.382882] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6a3de9bb953687a0000d822","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6a3de9bb953687a0000d822: done: 0.015893 sec","job_status":"done","queue_duration_s":1.439535,"scheduling_latency_s":1.439552,"redis_calls":13,"redis_duration_s":0.003089,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015893,"completed_at":"2026-09-01T10:35:46.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 275.423727] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0755d1543e8c52728b327927","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0755d1543e8c52728b327927: start","job_status":"start","queue_duration_s":1.457061,"scheduling_latency_s":1.457079}1310gitlab # [ 275.436371] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0755d1543e8c52728b327927","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0755d1543e8c52728b327927: done: 0.017582 sec","job_status":"done","queue_duration_s":1.457061,"scheduling_latency_s":1.457079,"redis_calls":13,"redis_duration_s":0.004247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017582,"completed_at":"2026-09-01T10:35:46.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 275.475943] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc1697e08599e0910e720ee","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc1697e08599e0910e720ee: start","job_status":"start","queue_duration_s":1.476512,"scheduling_latency_s":1.476529}1312gitlab # [ 275.488579] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc1697e08599e0910e720ee","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc1697e08599e0910e720ee: done: 0.015954 sec","job_status":"done","queue_duration_s":1.476512,"scheduling_latency_s":1.476529,"redis_calls":13,"redis_duration_s":0.002906,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015954,"completed_at":"2026-09-01T10:35:46.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 275.528048] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a92c4b6418826d65734af7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a92c4b6418826d65734af7: start","job_status":"start","queue_duration_s":1.493869,"scheduling_latency_s":1.493889}1314gitlab # [ 275.540463] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a92c4b6418826d65734af7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a92c4b6418826d65734af7: done: 0.015887 sec","job_status":"done","queue_duration_s":1.493869,"scheduling_latency_s":1.493889,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015887,"completed_at":"2026-09-01T10:35:46.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 275.580122] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b6fdeb09996ea298421aeac","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b6fdeb09996ea298421aeac: start","job_status":"start","queue_duration_s":1.511121,"scheduling_latency_s":1.511139}1316gitlab # [ 275.592810] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b6fdeb09996ea298421aeac","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b6fdeb09996ea298421aeac: done: 0.015767 sec","job_status":"done","queue_duration_s":1.511121,"scheduling_latency_s":1.511139,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015767,"completed_at":"2026-09-01T10:35:46.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 275.634146] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4ea4d2a0a913a81ef56b533","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4ea4d2a0a913a81ef56b533: start","job_status":"start","queue_duration_s":1.528275,"scheduling_latency_s":1.528291}1318gitlab # [ 275.646776] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4ea4d2a0a913a81ef56b533","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4ea4d2a0a913a81ef56b533: done: 0.016217 sec","job_status":"done","queue_duration_s":1.528275,"scheduling_latency_s":1.528291,"redis_calls":13,"redis_duration_s":0.002963,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016217,"completed_at":"2026-09-01T10:35:46.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 275.686939] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6f99d860490dbf6bb5cbcd7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6f99d860490dbf6bb5cbcd7: start","job_status":"start","queue_duration_s":1.545866,"scheduling_latency_s":1.545883}1320gitlab # [ 275.699714] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6f99d860490dbf6bb5cbcd7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6f99d860490dbf6bb5cbcd7: done: 0.017776 sec","job_status":"done","queue_duration_s":1.545866,"scheduling_latency_s":1.545883,"redis_calls":13,"redis_duration_s":0.003627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017776,"completed_at":"2026-09-01T10:35:46.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 275.739408] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4096cc9c7a20d21c620d481","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4096cc9c7a20d21c620d481: start","job_status":"start","queue_duration_s":1.565054,"scheduling_latency_s":1.565071}1322gitlab # [ 275.752855] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4096cc9c7a20d21c620d481","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4096cc9c7a20d21c620d481: done: 0.016641 sec","job_status":"done","queue_duration_s":1.565054,"scheduling_latency_s":1.565071,"redis_calls":13,"redis_duration_s":0.003087,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016641,"completed_at":"2026-09-01T10:35:46.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 275.792409] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f67ed15742a942eb14edc2d","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f67ed15742a942eb14edc2d: start","job_status":"start","queue_duration_s":1.583187,"scheduling_latency_s":1.583205}1324gitlab # [ 275.804870] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f67ed15742a942eb14edc2d","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f67ed15742a942eb14edc2d: done: 0.016306 sec","job_status":"done","queue_duration_s":1.583187,"scheduling_latency_s":1.583205,"redis_calls":13,"redis_duration_s":0.002966,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016306,"completed_at":"2026-09-01T10:35:46.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 275.845338] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"638ccaab97185112ecf8af29","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-638ccaab97185112ecf8af29: start","job_status":"start","queue_duration_s":1.60232,"scheduling_latency_s":1.602368}1326gitlab # [ 275.857966] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"638ccaab97185112ecf8af29","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-638ccaab97185112ecf8af29: done: 0.040227 sec","job_status":"done","queue_duration_s":1.60232,"scheduling_latency_s":1.602368,"redis_calls":13,"redis_duration_s":0.004926,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040227,"completed_at":"2026-09-01T10:35:46.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 275.897690] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9844477a29cc3dd39969371","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9844477a29cc3dd39969371: start","job_status":"start","queue_duration_s":1.645861,"scheduling_latency_s":1.645906}1328gitlab # [ 275.910248] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9844477a29cc3dd39969371","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9844477a29cc3dd39969371: done: 0.03471 sec","job_status":"done","queue_duration_s":1.645861,"scheduling_latency_s":1.645906,"redis_calls":13,"redis_duration_s":0.003817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002552,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03471,"completed_at":"2026-09-01T10:35:46.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 275.949680] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dfb6f49ed8f17d80a27a784","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dfb6f49ed8f17d80a27a784: start","job_status":"start","queue_duration_s":1.683399,"scheduling_latency_s":1.683442}1330gitlab # [ 275.962098] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dfb6f49ed8f17d80a27a784","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dfb6f49ed8f17d80a27a784: done: 0.027773 sec","job_status":"done","queue_duration_s":1.683399,"scheduling_latency_s":1.683442,"redis_calls":13,"redis_duration_s":0.003759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002481,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027773,"completed_at":"2026-09-01T10:35:46.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 276.000988] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39a9043cc220cdfc2beba83","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39a9043cc220cdfc2beba83: start","job_status":"start","queue_duration_s":1.713433,"scheduling_latency_s":1.713468}1332gitlab # [ 276.013369] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39a9043cc220cdfc2beba83","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39a9043cc220cdfc2beba83: done: 0.02218 sec","job_status":"done","queue_duration_s":1.713433,"scheduling_latency_s":1.713468,"redis_calls":13,"redis_duration_s":0.003351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02218,"completed_at":"2026-09-01T10:35:46.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 276.054180] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77eb7ee1e7f3a8af4d1b6f72","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77eb7ee1e7f3a8af4d1b6f72: start","job_status":"start","queue_duration_s":1.737701,"scheduling_latency_s":1.737732}1334gitlab # [ 276.066781] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77eb7ee1e7f3a8af4d1b6f72","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77eb7ee1e7f3a8af4d1b6f72: done: 0.02091 sec","job_status":"done","queue_duration_s":1.737701,"scheduling_latency_s":1.737732,"redis_calls":13,"redis_duration_s":0.003156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02091,"completed_at":"2026-09-01T10:35:46.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 276.106766] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e61ac5957aacf2ea5cdabc6","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e61ac5957aacf2ea5cdabc6: start","job_status":"start","queue_duration_s":1.760221,"scheduling_latency_s":1.760242}1336gitlab # [ 276.119527] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e61ac5957aacf2ea5cdabc6","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e61ac5957aacf2ea5cdabc6: done: 0.019605 sec","job_status":"done","queue_duration_s":1.760221,"scheduling_latency_s":1.760242,"redis_calls":13,"redis_duration_s":0.0032910000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019605,"completed_at":"2026-09-01T10:35:46.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 276.159441] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0bceacaade2c1e9eba818c1","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0bceacaade2c1e9eba818c1: start","job_status":"start","queue_duration_s":1.781743,"scheduling_latency_s":1.781763}1338gitlab # [ 276.172226] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0bceacaade2c1e9eba818c1","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0bceacaade2c1e9eba818c1: done: 0.018135 sec","job_status":"done","queue_duration_s":1.781743,"scheduling_latency_s":1.781763,"redis_calls":13,"redis_duration_s":0.003306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018135,"completed_at":"2026-09-01T10:35:46.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 276.211364] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:46.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2b8c6e29696f5b53578c14","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2b8c6e29696f5b53578c14: start","job_status":"start","queue_duration_s":1.801371,"scheduling_latency_s":1.801389}1340gitlab # [ 276.223988] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2b8c6e29696f5b53578c14","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2b8c6e29696f5b53578c14: done: 0.017622 sec","job_status":"done","queue_duration_s":1.801371,"scheduling_latency_s":1.801389,"redis_calls":13,"redis_duration_s":0.003058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017622,"completed_at":"2026-09-01T10:35:47.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 276.264708] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f211319e204d99e018ecc82e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f211319e204d99e018ecc82e: start","job_status":"start","queue_duration_s":1.820504,"scheduling_latency_s":1.820521}1342gitlab # [ 276.277077] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f211319e204d99e018ecc82e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f211319e204d99e018ecc82e: done: 0.01769 sec","job_status":"done","queue_duration_s":1.820504,"scheduling_latency_s":1.820521,"redis_calls":13,"redis_duration_s":0.0030749999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01769,"completed_at":"2026-09-01T10:35:47.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 276.316662] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f41da152da786481f0f73f12","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f41da152da786481f0f73f12: start","job_status":"start","queue_duration_s":1.839723,"scheduling_latency_s":1.83974}1344gitlab # [ 276.328953] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f41da152da786481f0f73f12","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f41da152da786481f0f73f12: done: 0.01768 sec","job_status":"done","queue_duration_s":1.839723,"scheduling_latency_s":1.83974,"redis_calls":13,"redis_duration_s":0.003151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01768,"completed_at":"2026-09-01T10:35:47.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 276.368252] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a8005c584d1712b0a8aebaf","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a8005c584d1712b0a8aebaf: start","job_status":"start","queue_duration_s":1.859816,"scheduling_latency_s":1.859836}1346gitlab # [ 276.380286] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a8005c584d1712b0a8aebaf","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a8005c584d1712b0a8aebaf: done: 0.016654 sec","job_status":"done","queue_duration_s":1.859816,"scheduling_latency_s":1.859836,"redis_calls":13,"redis_duration_s":0.0028139999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016654,"completed_at":"2026-09-01T10:35:47.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 276.419632] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4294d88676c16f4bbba8efe5","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4294d88676c16f4bbba8efe5: start","job_status":"start","queue_duration_s":1.878036,"scheduling_latency_s":1.878054}1348gitlab # [ 276.431961] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4294d88676c16f4bbba8efe5","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4294d88676c16f4bbba8efe5: done: 0.016539 sec","job_status":"done","queue_duration_s":1.878036,"scheduling_latency_s":1.878054,"redis_calls":13,"redis_duration_s":0.002841,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016539,"completed_at":"2026-09-01T10:35:47.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 276.471759] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a7785183e835faba40f129","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a7785183e835faba40f129: start","job_status":"start","queue_duration_s":1.896194,"scheduling_latency_s":1.896212}1350gitlab # [ 276.484150] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a7785183e835faba40f129","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a7785183e835faba40f129: done: 0.02929 sec","job_status":"done","queue_duration_s":1.896194,"scheduling_latency_s":1.896212,"redis_calls":13,"redis_duration_s":0.005020999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003541,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02929,"completed_at":"2026-09-01T10:35:47.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 276.522925] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c177c1cb75bbcc68eb8e421","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c177c1cb75bbcc68eb8e421: start","job_status":"start","queue_duration_s":1.928602,"scheduling_latency_s":1.928643}1352gitlab # [ 276.535199] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c177c1cb75bbcc68eb8e421","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c177c1cb75bbcc68eb8e421: done: 0.03625 sec","job_status":"done","queue_duration_s":1.928602,"scheduling_latency_s":1.928643,"redis_calls":13,"redis_duration_s":0.004097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03625,"completed_at":"2026-09-01T10:35:47.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 276.574445] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c37fcd0e964345d618a6d3","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c37fcd0e964345d618a6d3: start","job_status":"start","queue_duration_s":1.967825,"scheduling_latency_s":1.967864}1354gitlab # [ 276.586956] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c37fcd0e964345d618a6d3","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c37fcd0e964345d618a6d3: done: 0.031513 sec","job_status":"done","queue_duration_s":1.967825,"scheduling_latency_s":1.967864,"redis_calls":13,"redis_duration_s":0.004044,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031513,"completed_at":"2026-09-01T10:35:47.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 276.626267] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8563276c72cb305e4c8ec8ea","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8563276c72cb305e4c8ec8ea: start","job_status":"start","queue_duration_s":2.001679,"scheduling_latency_s":2.001716}1356gitlab # [ 276.638685] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8563276c72cb305e4c8ec8ea","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8563276c72cb305e4c8ec8ea: done: 0.026402 sec","job_status":"done","queue_duration_s":2.001679,"scheduling_latency_s":2.001716,"redis_calls":13,"redis_duration_s":0.0033,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001149,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026402,"completed_at":"2026-09-01T10:35:47.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 276.678986] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef10afef2893a6ef05927d0e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef10afef2893a6ef05927d0e: start","job_status":"start","queue_duration_s":2.029992,"scheduling_latency_s":2.030021}1358gitlab # [ 276.691747] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef10afef2893a6ef05927d0e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef10afef2893a6ef05927d0e: done: 0.020754 sec","job_status":"done","queue_duration_s":2.029992,"scheduling_latency_s":2.030021,"redis_calls":13,"redis_duration_s":0.003028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020754,"completed_at":"2026-09-01T10:35:47.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 276.731130] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ade6cd17b367b3a45dbe22b2","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ade6cd17b367b3a45dbe22b2: start","job_status":"start","queue_duration_s":2.052419,"scheduling_latency_s":2.052447}1360gitlab # [ 276.743733] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ade6cd17b367b3a45dbe22b2","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ade6cd17b367b3a45dbe22b2: done: 0.03587 sec","job_status":"done","queue_duration_s":2.052419,"scheduling_latency_s":2.052447,"redis_calls":13,"redis_duration_s":0.0052759999999999994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003694,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03587,"completed_at":"2026-09-01T10:35:47.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 276.784612] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"068b629928dfa1b4f777d8c7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-068b629928dfa1b4f777d8c7: start","job_status":"start","queue_duration_s":2.0919,"scheduling_latency_s":2.091954}1362gitlab # [ 276.797008] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"068b629928dfa1b4f777d8c7","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-068b629928dfa1b4f777d8c7: done: 0.04166 sec","job_status":"done","queue_duration_s":2.0919,"scheduling_latency_s":2.091954,"redis_calls":13,"redis_duration_s":0.005438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003438,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04166,"completed_at":"2026-09-01T10:35:47.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 276.836333] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63dc22b7b6c548fe0a0f6d2c","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63dc22b7b6c548fe0a0f6d2c: start","job_status":"start","queue_duration_s":2.137223,"scheduling_latency_s":2.137266}1364gitlab # [ 276.849795] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63dc22b7b6c548fe0a0f6d2c","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63dc22b7b6c548fe0a0f6d2c: done: 0.031624 sec","job_status":"done","queue_duration_s":2.137223,"scheduling_latency_s":2.137266,"redis_calls":13,"redis_duration_s":0.0047810000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031624,"completed_at":"2026-09-01T10:35:47.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 276.889225] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7eb19b96ca1df5d162f199","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7eb19b96ca1df5d162f199: start","job_status":"start","queue_duration_s":2.171524,"scheduling_latency_s":2.171559}1366gitlab # [ 276.901589] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7eb19b96ca1df5d162f199","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7eb19b96ca1df5d162f199: done: 0.424034 sec","job_status":"done","queue_duration_s":2.171524,"scheduling_latency_s":2.171559,"redis_calls":13,"redis_duration_s":0.277712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.275916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.424034,"completed_at":"2026-09-01T10:35:47.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 276.940881] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578b84c1b3dc1b7a9d6050f6","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578b84c1b3dc1b7a9d6050f6: start","job_status":"start","queue_duration_s":2.601574,"scheduling_latency_s":2.601631}1368gitlab # [ 276.953366] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578b84c1b3dc1b7a9d6050f6","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578b84c1b3dc1b7a9d6050f6: done: 0.045228 sec","job_status":"done","queue_duration_s":2.601574,"scheduling_latency_s":2.601631,"redis_calls":13,"redis_duration_s":0.005072,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003365,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045228,"completed_at":"2026-09-01T10:35:47.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 276.992574] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"596af2597cf669e2263aedba","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-596af2597cf669e2263aedba: start","job_status":"start","queue_duration_s":2.649647,"scheduling_latency_s":2.649688}1370gitlab # [ 277.004914] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"596af2597cf669e2263aedba","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-596af2597cf669e2263aedba: done: 0.029987 sec","job_status":"done","queue_duration_s":2.649647,"scheduling_latency_s":2.649688,"redis_calls":13,"redis_duration_s":0.004406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029987,"completed_at":"2026-09-01T10:35:47.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 277.044914] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d271f6ce6d94a8c0d539818e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d271f6ce6d94a8c0d539818e: start","job_status":"start","queue_duration_s":2.682228,"scheduling_latency_s":2.682262}1372gitlab # [ 277.058631] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d271f6ce6d94a8c0d539818e","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d271f6ce6d94a8c0d539818e: done: 0.026864 sec","job_status":"done","queue_duration_s":2.682228,"scheduling_latency_s":2.682262,"redis_calls":13,"redis_duration_s":0.003483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026864,"completed_at":"2026-09-01T10:35:47.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 277.098448] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e8096ede5b3b97f2e269ba","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e8096ede5b3b97f2e269ba: start","job_status":"start","queue_duration_s":2.712084,"scheduling_latency_s":2.71211}1374gitlab # [ 277.111229] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e8096ede5b3b97f2e269ba","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e8096ede5b3b97f2e269ba: done: 0.021896 sec","job_status":"done","queue_duration_s":2.712084,"scheduling_latency_s":2.71211,"redis_calls":13,"redis_duration_s":0.003182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021896,"completed_at":"2026-09-01T10:35:47.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 277.150954] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e242094b5fea05a9776038","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e242094b5fea05a9776038: start","job_status":"start","queue_duration_s":2.735654,"scheduling_latency_s":2.735675}1376gitlab # [ 277.163737] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e242094b5fea05a9776038","created_at":"2026-09-01T10:35:45.086Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-4da165b531ee4d99","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"84fc927d229f438adf4af09be871c27c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:45.181Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e242094b5fea05a9776038: done: 0.019021 sec","job_status":"done","queue_duration_s":2.735654,"scheduling_latency_s":2.735675,"redis_calls":13,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019021,"completed_at":"2026-09-01T10:35:47.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 277.204737] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.937Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5221ab458d0cbf757472d71b","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5221ab458d0cbf757472d71b: start","job_status":"start","queue_duration_s":1.840911,"scheduling_latency_s":1.84093}1378gitlab # [ 277.217374] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.958Z","message":"No existing merge request to be cleaned up."}1379gitlab # [ 277.219077] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.976Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5221ab458d0cbf757472d71b","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5221ab458d0cbf757472d71b: done: 0.03901 sec","job_status":"done","queue_duration_s":1.840911,"scheduling_latency_s":1.84093,"redis_calls":13,"redis_duration_s":0.003967,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000726,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041188,"duration_s":0.03901,"completed_at":"2026-09-01T10:35:47.976Z","load_balancing_strategy":"primary","db_duration_s":0.006909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 277.261586] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.979Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c383b12bedcb77f701144b6","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c383b12bedcb77f701144b6: start","job_status":"start","queue_duration_s":1.882777,"scheduling_latency_s":1.882799}1381gitlab # [ 277.274039] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:47.993Z","message":"No existing merge request to be cleaned up."}1382gitlab # [ 277.275698] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.004Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c383b12bedcb77f701144b6","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c383b12bedcb77f701144b6: done: 0.024791 sec","job_status":"done","queue_duration_s":1.882777,"scheduling_latency_s":1.882799,"redis_calls":10,"redis_duration_s":0.002929,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001679,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024791,"completed_at":"2026-09-01T10:35:48.004Z","load_balancing_strategy":"primary","db_duration_s":0.002959,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 277.315231] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.005Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c7b4c1be08743b8758aeced","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c7b4c1be08743b8758aeced: start","job_status":"start","queue_duration_s":1.909135,"scheduling_latency_s":1.909153}1384gitlab # [ 277.327708] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.019Z","message":"No existing merge request to be cleaned up."}1385gitlab # [ 277.329530] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.028Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c7b4c1be08743b8758aeced","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c7b4c1be08743b8758aeced: done: 0.023044 sec","job_status":"done","queue_duration_s":1.909135,"scheduling_latency_s":1.909153,"redis_calls":10,"redis_duration_s":0.00286,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001182,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023044,"completed_at":"2026-09-01T10:35:48.028Z","load_balancing_strategy":"primary","db_duration_s":0.002764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 277.368622] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.030Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cb2b704fee9ead1387b0e7b4","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cb2b704fee9ead1387b0e7b4: start","job_status":"start","queue_duration_s":1.933782,"scheduling_latency_s":1.9338}1387gitlab # [ 277.381024] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.043Z","message":"No existing merge request to be cleaned up."}1388gitlab # [ 277.382727] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:35:48.055Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cb2b704fee9ead1387b0e7b4","created_at":"2026-09-01T10:35:46.082Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-026e190dab11410f","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bdb86ac18f2263732517f9355707fbcc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:35:46.096Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cb2b704fee9ead1387b0e7b4: done: 0.025501 sec","job_status":"done","queue_duration_s":1.933782,"scheduling_latency_s":1.9338,"redis_calls":10,"redis_duration_s":0.002983,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025501,"completed_at":"2026-09-01T10:35:48.055Z","load_balancing_strategy":"primary","db_duration_s":0.002686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 277.421878] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:04.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"62820067f622b05b79bd4e76","created_at":"2026-09-01T10:36:04.896Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1e7736706d88d83d23eb53de6fb2767","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.915Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-62820067f622b05b79bd4e76: start","job_status":"start","queue_duration_s":0.005069,"scheduling_latency_s":0.00514}1390gitlab # [ 277.436170] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"62820067f622b05b79bd4e76","created_at":"2026-09-01T10:36:04.896Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1e7736706d88d83d23eb53de6fb2767","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.915Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-62820067f622b05b79bd4e76: done: 1.418408 sec","job_status":"done","queue_duration_s":0.005069,"scheduling_latency_s":0.00514,"redis_calls":563,"redis_duration_s":0.725757,"redis_read_bytes":688,"redis_write_bytes":48824,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001472,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.714089,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.683608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.418408,"completed_at":"2026-09-01T10:36:06.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 277.479142] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7ac78fcd20626269ab0d82a4","created_at":"2026-09-01T10:36:04.931Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"874ac021b4788e419806f40d7e05fcab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.938Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7ac78fcd20626269ab0d82a4: start","job_status":"start","queue_duration_s":1.403618,"scheduling_latency_s":1.403665}1392gitlab # [ 277.494530] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.358Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1393gitlab # [ 277.498079] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7ac78fcd20626269ab0d82a4","created_at":"2026-09-01T10:36:04.931Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"874ac021b4788e419806f40d7e05fcab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.938Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7ac78fcd20626269ab0d82a4: done: 0.027117 sec","job_status":"done","queue_duration_s":1.403618,"scheduling_latency_s":1.403665,"redis_calls":7,"redis_duration_s":0.002687,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00069,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027117,"completed_at":"2026-09-01T10:36:06.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 277.539493] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"feb976b0a5156933960f331e","created_at":"2026-09-01T10:36:04.956Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d839465283e737f5e7f79684f1e355b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.962Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-feb976b0a5156933960f331e: start","job_status":"start","queue_duration_s":1.409312,"scheduling_latency_s":1.409349}1395gitlab # [ 277.554420] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.387Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1396gitlab # [ 277.557962] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"feb976b0a5156933960f331e","created_at":"2026-09-01T10:36:04.956Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d839465283e737f5e7f79684f1e355b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.962Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-feb976b0a5156933960f331e: done: 0.026332 sec","job_status":"done","queue_duration_s":1.409312,"scheduling_latency_s":1.409349,"redis_calls":7,"redis_duration_s":0.002419,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026332,"completed_at":"2026-09-01T10:36:06.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 277.599095] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9d47d13880e35de5e63362d2","created_at":"2026-09-01T10:36:04.981Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a077de8ad0016be2bbf6680c9c791712","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.992Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9d47d13880e35de5e63362d2: start","job_status":"start","queue_duration_s":1.410787,"scheduling_latency_s":1.410826}1398gitlab # [ 277.613105] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9d47d13880e35de5e63362d2","created_at":"2026-09-01T10:36:04.981Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a077de8ad0016be2bbf6680c9c791712","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:04.992Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9d47d13880e35de5e63362d2: done: 0.063201 sec","job_status":"done","queue_duration_s":1.410787,"scheduling_latency_s":1.410826,"redis_calls":7,"redis_duration_s":0.002578,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.063201,"completed_at":"2026-09-01T10:36:06.465Z","load_balancing_strategy":"primary","db_duration_s":0.024542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 277.654011] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b58d521fe0b3d143c52a47a5","created_at":"2026-09-01T10:36:05.018Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc6297ed31df94315f23643557b4343c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.031Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b58d521fe0b3d143c52a47a5: start","job_status":"start","queue_duration_s":1.437581,"scheduling_latency_s":1.437632}1400gitlab # [ 277.669542] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b58d521fe0b3d143c52a47a5","created_at":"2026-09-01T10:36:05.018Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc6297ed31df94315f23643557b4343c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.031Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b58d521fe0b3d143c52a47a5: done: 0.048453 sec","job_status":"done","queue_duration_s":1.437581,"scheduling_latency_s":1.437632,"redis_calls":9,"redis_duration_s":0.003972,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00116916,"exclusive_lock_hold_duration_s":0.00812536,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.048453,"completed_at":"2026-09-01T10:36:06.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 277.711434] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809a1e09e1fd1cf8d7672a8","created_at":"2026-09-01T10:36:05.053Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9db73ea1e846edec056e04f7206b043","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.064Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809a1e09e1fd1cf8d7672a8: start","job_status":"start","queue_duration_s":1.458013,"scheduling_latency_s":1.458069}1402gitlab # [ 277.725256] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809a1e09e1fd1cf8d7672a8","created_at":"2026-09-01T10:36:05.053Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9db73ea1e846edec056e04f7206b043","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.064Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809a1e09e1fd1cf8d7672a8: done: 0.053967 sec","job_status":"done","queue_duration_s":1.458013,"scheduling_latency_s":1.458069,"redis_calls":9,"redis_duration_s":0.005287999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00138724,"exclusive_lock_hold_duration_s":0.00916748,"duration_s":0.053967,"completed_at":"2026-09-01T10:36:06.576Z","load_balancing_strategy":"primary","db_duration_s":0.002635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 277.765252] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"234b9088431a484d2208cc7b","created_at":"2026-09-01T10:36:05.093Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a20a692521b88e913480fb4e7374a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:36:05.105Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-234b9088431a484d2208cc7b: start","job_status":"start","queue_duration_s":1.475486,"scheduling_latency_s":1.475538}1404gitlab # [ 277.779111] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.602Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1405gitlab # [ 277.782946] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"234b9088431a484d2208cc7b","created_at":"2026-09-01T10:36:05.093Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a20a692521b88e913480fb4e7374a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:36:05.105Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-234b9088431a484d2208cc7b: done: 0.040022 sec","job_status":"done","queue_duration_s":1.475486,"scheduling_latency_s":1.475538,"redis_calls":7,"redis_duration_s":0.003532,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040022,"completed_at":"2026-09-01T10:36:06.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 277.822526] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8140e0586cbafc7b688693db","created_at":"2026-09-01T10:36:05.137Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.148Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8140e0586cbafc7b688693db: start","job_status":"start","queue_duration_s":1.476077,"scheduling_latency_s":1.476139}1407gitlab # [ 277.836237] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.818Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8140e0586cbafc7b688693db","created_at":"2026-09-01T10:36:05.137Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.148Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8140e0586cbafc7b688693db: done: 0.193878 sec","job_status":"done","queue_duration_s":1.476077,"scheduling_latency_s":1.476139,"redis_calls":60,"redis_duration_s":0.023941999999999998,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000932,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.021896,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.193878,"completed_at":"2026-09-01T10:36:06.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 277.880705] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"74b2ed88243ba79b5ccbf0fd","created_at":"2026-09-01T10:36:05.172Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a90eb6fe8c009628057710c5b94386b5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.319Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-74b2ed88243ba79b5ccbf0fd: start","job_status":"start","queue_duration_s":1.502047,"scheduling_latency_s":1.502085}1409gitlab # [ 277.922232] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"74b2ed88243ba79b5ccbf0fd","created_at":"2026-09-01T10:36:05.172Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a90eb6fe8c009628057710c5b94386b5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.319Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-74b2ed88243ba79b5ccbf0fd: done: 0.02714 sec","job_status":"done","queue_duration_s":1.502047,"scheduling_latency_s":1.502085,"redis_calls":12,"redis_duration_s":0.003653,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038314,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.02714,"completed_at":"2026-09-01T10:36:06.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 277.987710] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"7d223dc93cd13cee1522e13f","created_at":"2026-09-01T10:36:05.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82f2d472584f54b502a2a3db82fdab77","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.374Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-7d223dc93cd13cee1522e13f: start","job_status":"start","queue_duration_s":1.475453,"scheduling_latency_s":1.475503}1411gitlab # [ 278.002824] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.875Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"7d223dc93cd13cee1522e13f","created_at":"2026-09-01T10:36:05.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82f2d472584f54b502a2a3db82fdab77","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.374Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-7d223dc93cd13cee1522e13f: done: 0.025734 sec","job_status":"done","queue_duration_s":1.475453,"scheduling_latency_s":1.475503,"redis_calls":12,"redis_duration_s":0.003595,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000717,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000587,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041616,"duration_s":0.025734,"completed_at":"2026-09-01T10:36:06.875Z","load_balancing_strategy":"primary","db_duration_s":0.000631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 278.048970] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a82e7879417721900236702","created_at":"2026-09-01T10:36:05.382Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4897af4e51ad3e05290c7f1dabb6de3f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.391Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a82e7879417721900236702: start","job_status":"start","queue_duration_s":1.48599,"scheduling_latency_s":1.486023}1413gitlab # [ 278.063279] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6a82e7879417721900236702","created_at":"2026-09-01T10:36:05.382Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4897af4e51ad3e05290c7f1dabb6de3f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.391Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6a82e7879417721900236702: done: 0.029276 sec","job_status":"done","queue_duration_s":1.48599,"scheduling_latency_s":1.486023,"redis_calls":10,"redis_duration_s":0.00313,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001807,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00765066,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.029276,"completed_at":"2026-09-01T10:36:06.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1414gitlab # [ 278.107523] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"e28099d4bf0c72039e67877a","created_at":"2026-09-01T10:36:05.400Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"979735bb6f9b25930e51940f73f10258","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.421Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-e28099d4bf0c72039e67877a: start","job_status":"start","queue_duration_s":1.487195,"scheduling_latency_s":1.487222}1415gitlab # [ 278.122082] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"e28099d4bf0c72039e67877a","created_at":"2026-09-01T10:36:05.400Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"979735bb6f9b25930e51940f73f10258","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.421Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-e28099d4bf0c72039e67877a: done: 0.084632 sec","job_status":"done","queue_duration_s":1.487195,"scheduling_latency_s":1.487222,"redis_calls":10,"redis_duration_s":0.004005,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00080248,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.084632,"completed_at":"2026-09-01T10:36:06.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 278.166495] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:06.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0816d91ef72506ae5293cb04","created_at":"2026-09-01T10:36:05.432Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8917f55f5223f06363b205a790447b70","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:36:05.445Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0816d91ef72506ae5293cb04: start","job_status":"start","queue_duration_s":1.551491,"scheduling_latency_s":1.551526}1417gitlab # [ 278.179714] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0816d91ef72506ae5293cb04","created_at":"2026-09-01T10:36:05.432Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8917f55f5223f06363b205a790447b70","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:36:05.445Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0816d91ef72506ae5293cb04: done: 0.051776 sec","job_status":"done","queue_duration_s":1.551491,"scheduling_latency_s":1.551526,"redis_calls":7,"redis_duration_s":0.003171,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051776,"completed_at":"2026-09-01T10:36:07.048Z","load_balancing_strategy":"primary","db_duration_s":0.003691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 278.218612] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"41055c1529cd2824f42a5f01","created_at":"2026-09-01T10:36:05.460Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9954cdff12f0dc48fbe4f34066328e44","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.479Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-41055c1529cd2824f42a5f01: start","job_status":"start","queue_duration_s":1.572612,"scheduling_latency_s":1.572667}1419gitlab # [ 278.233214] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"41055c1529cd2824f42a5f01","created_at":"2026-09-01T10:36:05.460Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9954cdff12f0dc48fbe4f34066328e44","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.479Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-41055c1529cd2824f42a5f01: done: 0.08052 sec","job_status":"done","queue_duration_s":1.572612,"scheduling_latency_s":1.572667,"redis_calls":10,"redis_duration_s":0.005168,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000931,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00086136,"duration_s":0.08052,"completed_at":"2026-09-01T10:36:07.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 278.275616] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"8782abd05cee8b2caed5f319","created_at":"2026-09-01T10:36:05.487Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98af778f244565e4af76ebf84732d341","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.494Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-8782abd05cee8b2caed5f319: start","job_status":"start","queue_duration_s":1.640908,"scheduling_latency_s":1.640957}1421gitlab # [ 278.290706] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"8782abd05cee8b2caed5f319","created_at":"2026-09-01T10:36:05.487Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98af778f244565e4af76ebf84732d341","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.494Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-8782abd05cee8b2caed5f319: done: 0.386923 sec","job_status":"done","queue_duration_s":1.640908,"scheduling_latency_s":1.640957,"redis_calls":11,"redis_duration_s":0.003693,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.288891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00118334,"exclusive_lock_hold_duration_s":0.34994126,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.386923,"completed_at":"2026-09-01T10:36:07.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.111503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 278.335224] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a73184248f82e41fdea0e57f","created_at":"2026-09-01T10:36:05.500Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8545e5c0ecd55dd173257704ef727bec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.509Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a73184248f82e41fdea0e57f: start","job_status":"start","queue_duration_s":2.015558,"scheduling_latency_s":2.01559}1423gitlab # [ 278.350047] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a73184248f82e41fdea0e57f","created_at":"2026-09-01T10:36:05.500Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8545e5c0ecd55dd173257704ef727bec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.509Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a73184248f82e41fdea0e57f: done: 0.046969 sec","job_status":"done","queue_duration_s":2.015558,"scheduling_latency_s":2.01559,"redis_calls":9,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101656,"exclusive_lock_hold_duration_s":0.01489926,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.046969,"completed_at":"2026-09-01T10:36:07.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 278.393115] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"5005817d50746d19065db168","created_at":"2026-09-01T10:36:05.516Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3adb7b8ebf8c8e76a151653e5609df8e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.531Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-5005817d50746d19065db168: start","job_status":"start","queue_duration_s":2.041622,"scheduling_latency_s":2.041663}1425gitlab # [ 278.406957] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"5005817d50746d19065db168","created_at":"2026-09-01T10:36:05.516Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3adb7b8ebf8c8e76a151653e5609df8e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.531Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-5005817d50746d19065db168: done: 0.042836 sec","job_status":"done","queue_duration_s":2.041622,"scheduling_latency_s":2.041663,"redis_calls":20,"redis_duration_s":0.004188,"redis_read_bytes":20,"redis_write_bytes":3246,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001911,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000399,"redis_queues_read_bytes":3,"redis_queues_write_bytes":816,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026268,"duration_s":0.042836,"completed_at":"2026-09-01T10:36:07.616Z","load_balancing_strategy":"primary","db_duration_s":0.002189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 278.449975] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"35e728adba69e188e17c840d","created_at":"2026-09-01T10:36:05.541Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d01426ff7f7ef8284006b6000eb6a5aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.547Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-35e728adba69e188e17c840d: start","job_status":"start","queue_duration_s":2.0701,"scheduling_latency_s":2.070121}1427gitlab # [ 278.464228] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"35e728adba69e188e17c840d","created_at":"2026-09-01T10:36:05.541Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d01426ff7f7ef8284006b6000eb6a5aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.547Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-35e728adba69e188e17c840d: done: 0.014319 sec","job_status":"done","queue_duration_s":2.0701,"scheduling_latency_s":2.070121,"redis_calls":7,"redis_duration_s":0.001356,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014319,"completed_at":"2026-09-01T10:36:07.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 278.506155] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5ce08a199d9ce7e5b407fd5f","created_at":"2026-09-01T10:36:05.560Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.566Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5ce08a199d9ce7e5b407fd5f: start","job_status":"start","queue_duration_s":2.066043,"scheduling_latency_s":2.066063}1429gitlab # [ 278.519686] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5ce08a199d9ce7e5b407fd5f","created_at":"2026-09-01T10:36:05.560Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.566Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5ce08a199d9ce7e5b407fd5f: done: 0.027264 sec","job_status":"done","queue_duration_s":2.066043,"scheduling_latency_s":2.066063,"redis_calls":14,"redis_duration_s":0.002198,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027264,"completed_at":"2026-09-01T10:36:07.660Z","load_balancing_strategy":"primary","db_duration_s":0.001346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 278.560431] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6001df9a53f4f19ea0079461","created_at":"2026-09-01T10:36:05.580Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbfa5770296d9980fc4c1f7b3192340","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.586Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6001df9a53f4f19ea0079461: start","job_status":"start","queue_duration_s":2.074641,"scheduling_latency_s":2.074662}1431gitlab # [ 278.574602] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6001df9a53f4f19ea0079461","created_at":"2026-09-01T10:36:05.580Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbfa5770296d9980fc4c1f7b3192340","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.586Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6001df9a53f4f19ea0079461: done: 0.057267 sec","job_status":"done","queue_duration_s":2.074641,"scheduling_latency_s":2.074662,"redis_calls":9,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056292,"exclusive_lock_hold_duration_s":0.04081618,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.057267,"completed_at":"2026-09-01T10:36:07.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 278.618703] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4a53e56284448ef49e1a2b92","created_at":"2026-09-01T10:36:05.606Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f165e9abf856516868031945b1f859a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.613Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4a53e56284448ef49e1a2b92: start","job_status":"start","queue_duration_s":2.107363,"scheduling_latency_s":2.107389}1433gitlab # [ 278.662299] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4a53e56284448ef49e1a2b92","created_at":"2026-09-01T10:36:05.606Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f165e9abf856516868031945b1f859a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.613Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4a53e56284448ef49e1a2b92: done: 0.016313 sec","job_status":"done","queue_duration_s":2.107363,"scheduling_latency_s":2.107389,"redis_calls":7,"redis_duration_s":0.001622,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000355,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016313,"completed_at":"2026-09-01T10:36:07.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 278.739736] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5c51d354c6bfa87045d84733","created_at":"2026-09-01T10:36:05.637Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f52e949545884bfeace23117e82b2515","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.647Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5c51d354c6bfa87045d84733: start","job_status":"start","queue_duration_s":2.090694,"scheduling_latency_s":2.090718}1435gitlab # [ 278.759827] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5c51d354c6bfa87045d84733","created_at":"2026-09-01T10:36:05.637Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f52e949545884bfeace23117e82b2515","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.647Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5c51d354c6bfa87045d84733: done: 0.017273 sec","job_status":"done","queue_duration_s":2.090694,"scheduling_latency_s":2.090718,"redis_calls":7,"redis_duration_s":0.001221,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017273,"completed_at":"2026-09-01T10:36:07.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 278.803557] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.756Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"12c3cb77cf5fc289e0f17f32","created_at":"2026-09-01T10:36:05.659Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"e1bd9e4909353c6afbae5c09b1ae4487","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.673Z","job_size_bytes":3,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-12c3cb77cf5fc289e0f17f32: start","job_status":"start","queue_duration_s":2.083228,"scheduling_latency_s":2.083253}1437gitlab # [ 278.817554] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.777Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"12c3cb77cf5fc289e0f17f32","created_at":"2026-09-01T10:36:05.659Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"e1bd9e4909353c6afbae5c09b1ae4487","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.673Z","job_size_bytes":3,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-12c3cb77cf5fc289e0f17f32: done: 0.020456 sec","job_status":"done","queue_duration_s":2.083228,"scheduling_latency_s":2.083253,"redis_calls":10,"redis_duration_s":0.001702,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027288,"duration_s":0.020456,"completed_at":"2026-09-01T10:36:07.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 278.859458] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"149770970f124feda91bdb18","created_at":"2026-09-01T10:36:05.682Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d7a62a3c19d2e491aea4355b3f7bed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:36:05.688Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-149770970f124feda91bdb18: start","job_status":"start","queue_duration_s":2.090033,"scheduling_latency_s":2.090056}1439gitlab # [ 278.873079] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.787Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1440gitlab # [ 278.876354] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"149770970f124feda91bdb18","created_at":"2026-09-01T10:36:05.682Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d7a62a3c19d2e491aea4355b3f7bed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:36:05.688Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-149770970f124feda91bdb18: done: 0.014018 sec","job_status":"done","queue_duration_s":2.090033,"scheduling_latency_s":2.090056,"redis_calls":7,"redis_duration_s":0.001173,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014018,"completed_at":"2026-09-01T10:36:07.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 278.916706] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7a8db37a54a53e555ef6c5ff","created_at":"2026-09-01T10:36:05.693Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b4a78158e04b5af3d37ca60c9351e06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.704Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7a8db37a54a53e555ef6c5ff: start","job_status":"start","queue_duration_s":2.089317,"scheduling_latency_s":2.089338}1442gitlab # [ 278.931179] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.802Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1443gitlab # [ 278.935138] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7a8db37a54a53e555ef6c5ff","created_at":"2026-09-01T10:36:05.693Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b4a78158e04b5af3d37ca60c9351e06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.704Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7a8db37a54a53e555ef6c5ff: done: 0.013441 sec","job_status":"done","queue_duration_s":2.089317,"scheduling_latency_s":2.089338,"redis_calls":7,"redis_duration_s":0.00106,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013441,"completed_at":"2026-09-01T10:36:07.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 278.975527] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"37d89546c3452ff8e37592f5","created_at":"2026-09-01T10:36:05.710Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2531d043a2fe8dc0ea2c828c96dca4a9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.727Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-37d89546c3452ff8e37592f5: start","job_status":"start","queue_duration_s":2.080852,"scheduling_latency_s":2.08087}1445gitlab # [ 278.989853] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"37d89546c3452ff8e37592f5","created_at":"2026-09-01T10:36:05.710Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2531d043a2fe8dc0ea2c828c96dca4a9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.727Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-37d89546c3452ff8e37592f5: done: 0.024493 sec","job_status":"done","queue_duration_s":2.080852,"scheduling_latency_s":2.08087,"redis_calls":12,"redis_duration_s":0.001671,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045922,"exclusive_lock_hold_duration_s":0.00593138,"duration_s":0.024493,"completed_at":"2026-09-01T10:36:07.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 279.031273] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8a989fb9152d66a9cf9b7e48","created_at":"2026-09-01T10:36:05.765Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d426338eacc47741c075a06e41f7e12","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.779Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8a989fb9152d66a9cf9b7e48: start","job_status":"start","queue_duration_s":2.054555,"scheduling_latency_s":2.054574}1447gitlab # [ 279.045328] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.853Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8a989fb9152d66a9cf9b7e48","created_at":"2026-09-01T10:36:05.765Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d426338eacc47741c075a06e41f7e12","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.779Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8a989fb9152d66a9cf9b7e48: done: 0.019586 sec","job_status":"done","queue_duration_s":2.054555,"scheduling_latency_s":2.054574,"redis_calls":7,"redis_duration_s":0.0009989999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019586,"completed_at":"2026-09-01T10:36:07.853Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 279.085113] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"701527abb1be0d0cd43ef67b","created_at":"2026-09-01T10:36:05.808Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2601d8387add599631c5a1c488e20a47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.820Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-701527abb1be0d0cd43ef67b: start","job_status":"start","queue_duration_s":2.034424,"scheduling_latency_s":2.034444}1449gitlab # [ 279.099444] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.862Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1450gitlab # [ 279.103168] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"701527abb1be0d0cd43ef67b","created_at":"2026-09-01T10:36:05.808Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2601d8387add599631c5a1c488e20a47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:05.820Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-701527abb1be0d0cd43ef67b: done: 0.012838 sec","job_status":"done","queue_duration_s":2.034424,"scheduling_latency_s":2.034444,"redis_calls":7,"redis_duration_s":0.001001,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012838,"completed_at":"2026-09-01T10:36:07.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 279.144595] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65ef3d7435dee665fc2292f9","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65ef3d7435dee665fc2292f9: start","job_status":"start","queue_duration_s":1.06156,"scheduling_latency_s":1.061578}1452gitlab # [ 279.156831] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65ef3d7435dee665fc2292f9","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65ef3d7435dee665fc2292f9: done: 0.015139 sec","job_status":"done","queue_duration_s":1.06156,"scheduling_latency_s":1.061578,"redis_calls":13,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015139,"completed_at":"2026-09-01T10:36:07.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 279.195907] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33665408ac0ca96fd391adf4","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33665408ac0ca96fd391adf4: start","job_status":"start","queue_duration_s":1.077812,"scheduling_latency_s":1.077829}1454gitlab # [ 279.208457] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33665408ac0ca96fd391adf4","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33665408ac0ca96fd391adf4: done: 0.014621 sec","job_status":"done","queue_duration_s":1.077812,"scheduling_latency_s":1.077829,"redis_calls":13,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014621,"completed_at":"2026-09-01T10:36:07.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 279.247307] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f40dbf2df5ddc193a85eb7","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f40dbf2df5ddc193a85eb7: start","job_status":"start","queue_duration_s":1.09354,"scheduling_latency_s":1.093557}1456gitlab # [ 279.259889] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f40dbf2df5ddc193a85eb7","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f40dbf2df5ddc193a85eb7: done: 0.014679 sec","job_status":"done","queue_duration_s":1.09354,"scheduling_latency_s":1.093557,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014679,"completed_at":"2026-09-01T10:36:07.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 279.299595] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"307f38897f7c564a8e75071b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-307f38897f7c564a8e75071b: start","job_status":"start","queue_duration_s":1.109398,"scheduling_latency_s":1.109417}1458gitlab # [ 279.313370] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"307f38897f7c564a8e75071b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-307f38897f7c564a8e75071b: done: 0.015421 sec","job_status":"done","queue_duration_s":1.109398,"scheduling_latency_s":1.109417,"redis_calls":13,"redis_duration_s":0.0016519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015421,"completed_at":"2026-09-01T10:36:07.932Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 279.353275] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936b14cb18349bf2008ac8d1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936b14cb18349bf2008ac8d1: start","job_status":"start","queue_duration_s":1.126032,"scheduling_latency_s":1.12605}1460gitlab # [ 279.365992] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936b14cb18349bf2008ac8d1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936b14cb18349bf2008ac8d1: done: 0.015207 sec","job_status":"done","queue_duration_s":1.126032,"scheduling_latency_s":1.12605,"redis_calls":13,"redis_duration_s":0.0017400000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-09-01T10:36:07.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 279.405283] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fc61475c19c6a2656ab3ef3","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fc61475c19c6a2656ab3ef3: start","job_status":"start","queue_duration_s":1.142443,"scheduling_latency_s":1.142462}1462gitlab # [ 279.417944] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fc61475c19c6a2656ab3ef3","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fc61475c19c6a2656ab3ef3: done: 0.015431 sec","job_status":"done","queue_duration_s":1.142443,"scheduling_latency_s":1.142462,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015431,"completed_at":"2026-09-01T10:36:07.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 279.457534] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"543ccae53b83d0a0daf2181b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-543ccae53b83d0a0daf2181b: start","job_status":"start","queue_duration_s":1.159184,"scheduling_latency_s":1.159239}1464gitlab # [ 279.470126] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"543ccae53b83d0a0daf2181b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-543ccae53b83d0a0daf2181b: done: 0.015542 sec","job_status":"done","queue_duration_s":1.159184,"scheduling_latency_s":1.159239,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015542,"completed_at":"2026-09-01T10:36:07.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 279.509511] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"982fa48247f1e28bb346f57e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-982fa48247f1e28bb346f57e: start","job_status":"start","queue_duration_s":1.175988,"scheduling_latency_s":1.176007}1466gitlab # [ 279.523059] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:07.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"982fa48247f1e28bb346f57e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-982fa48247f1e28bb346f57e: done: 0.015558 sec","job_status":"done","queue_duration_s":1.175988,"scheduling_latency_s":1.176007,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015558,"completed_at":"2026-09-01T10:36:07.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 279.562754] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30be7dab576ab8c5bfe51ce8","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30be7dab576ab8c5bfe51ce8: start","job_status":"start","queue_duration_s":1.192759,"scheduling_latency_s":1.192776}1468gitlab # [ 279.575165] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30be7dab576ab8c5bfe51ce8","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30be7dab576ab8c5bfe51ce8: done: 0.015442 sec","job_status":"done","queue_duration_s":1.192759,"scheduling_latency_s":1.192776,"redis_calls":13,"redis_duration_s":0.0018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015442,"completed_at":"2026-09-01T10:36:08.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 279.614900] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"846014b69e6b343d7428df39","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-846014b69e6b343d7428df39: start","job_status":"start","queue_duration_s":1.209283,"scheduling_latency_s":1.209302}1470gitlab # [ 279.627566] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"846014b69e6b343d7428df39","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-846014b69e6b343d7428df39: done: 0.015174 sec","job_status":"done","queue_duration_s":1.209283,"scheduling_latency_s":1.209302,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015174,"completed_at":"2026-09-01T10:36:08.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 279.667126] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b485a3b367ebc9f778e181","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b485a3b367ebc9f778e181: start","job_status":"start","queue_duration_s":1.22553,"scheduling_latency_s":1.225547}1472gitlab # [ 279.679453] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b485a3b367ebc9f778e181","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b485a3b367ebc9f778e181: done: 0.015157 sec","job_status":"done","queue_duration_s":1.22553,"scheduling_latency_s":1.225547,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015157,"completed_at":"2026-09-01T10:36:08.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 279.719124] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fa73b04f6fc6f1de68245e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fa73b04f6fc6f1de68245e: start","job_status":"start","queue_duration_s":1.24179,"scheduling_latency_s":1.241808}1474gitlab # [ 279.731484] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fa73b04f6fc6f1de68245e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fa73b04f6fc6f1de68245e: done: 0.015408 sec","job_status":"done","queue_duration_s":1.24179,"scheduling_latency_s":1.241808,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015408,"completed_at":"2026-09-01T10:36:08.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 279.769995] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef165eb7a362132fb60f7ec6","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef165eb7a362132fb60f7ec6: start","job_status":"start","queue_duration_s":1.258336,"scheduling_latency_s":1.258353}1476gitlab # [ 279.782205] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef165eb7a362132fb60f7ec6","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef165eb7a362132fb60f7ec6: done: 0.015586 sec","job_status":"done","queue_duration_s":1.258336,"scheduling_latency_s":1.258353,"redis_calls":13,"redis_duration_s":0.0016899999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015586,"completed_at":"2026-09-01T10:36:08.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 279.820598] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11865aa494205f89ba31b36b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11865aa494205f89ba31b36b: start","job_status":"start","queue_duration_s":1.2751,"scheduling_latency_s":1.275117}1478gitlab # [ 279.832670] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11865aa494205f89ba31b36b","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11865aa494205f89ba31b36b: done: 0.015148 sec","job_status":"done","queue_duration_s":1.2751,"scheduling_latency_s":1.275117,"redis_calls":13,"redis_duration_s":0.0015710000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015148,"completed_at":"2026-09-01T10:36:08.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 279.872780] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40cd686c4bbb9492236d16bc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40cd686c4bbb9492236d16bc: start","job_status":"start","queue_duration_s":1.291603,"scheduling_latency_s":1.291622}1480gitlab # [ 279.909457] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40cd686c4bbb9492236d16bc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40cd686c4bbb9492236d16bc: done: 0.014985 sec","job_status":"done","queue_duration_s":1.291603,"scheduling_latency_s":1.291622,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014985,"completed_at":"2026-09-01T10:36:08.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 279.994414] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c3d625bbb75e1c61f781459","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c3d625bbb75e1c61f781459: start","job_status":"start","queue_duration_s":1.307939,"scheduling_latency_s":1.307956}1482gitlab # [ 280.029443] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c3d625bbb75e1c61f781459","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c3d625bbb75e1c61f781459: done: 0.0151 sec","job_status":"done","queue_duration_s":1.307939,"scheduling_latency_s":1.307956,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0151,"completed_at":"2026-09-01T10:36:08.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 280.088186] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bff7c811ea12a60e4554543","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bff7c811ea12a60e4554543: start","job_status":"start","queue_duration_s":1.324745,"scheduling_latency_s":1.324765}1484gitlab # [ 280.101944] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bff7c811ea12a60e4554543","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bff7c811ea12a60e4554543: done: 0.015748 sec","job_status":"done","queue_duration_s":1.324745,"scheduling_latency_s":1.324765,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015748,"completed_at":"2026-09-01T10:36:08.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 280.198598] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788137427dd5b698a5aad338","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788137427dd5b698a5aad338: start","job_status":"start","queue_duration_s":1.341873,"scheduling_latency_s":1.341893}1486gitlab # [ 280.219482] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788137427dd5b698a5aad338","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788137427dd5b698a5aad338: done: 0.015658 sec","job_status":"done","queue_duration_s":1.341873,"scheduling_latency_s":1.341893,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015658,"completed_at":"2026-09-01T10:36:08.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 280.265383] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58fe8fd28decc905bcbb15cc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58fe8fd28decc905bcbb15cc: start","job_status":"start","queue_duration_s":1.358986,"scheduling_latency_s":1.359005}1488gitlab # [ 280.277559] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58fe8fd28decc905bcbb15cc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58fe8fd28decc905bcbb15cc: done: 0.015205 sec","job_status":"done","queue_duration_s":1.358986,"scheduling_latency_s":1.359005,"redis_calls":13,"redis_duration_s":0.001758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015205,"completed_at":"2026-09-01T10:36:08.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 280.316114] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f8176f4fc331e775061cf2","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f8176f4fc331e775061cf2: start","job_status":"start","queue_duration_s":1.375357,"scheduling_latency_s":1.375375}1490gitlab # [ 280.327902] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f8176f4fc331e775061cf2","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f8176f4fc331e775061cf2: done: 0.014634 sec","job_status":"done","queue_duration_s":1.375357,"scheduling_latency_s":1.375375,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014634,"completed_at":"2026-09-01T10:36:08.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 280.366804] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe73c91ed0b325e54c93216","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe73c91ed0b325e54c93216: start","job_status":"start","queue_duration_s":1.391064,"scheduling_latency_s":1.391082}1492gitlab # [ 280.379200] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe73c91ed0b325e54c93216","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe73c91ed0b325e54c93216: done: 0.014561 sec","job_status":"done","queue_duration_s":1.391064,"scheduling_latency_s":1.391082,"redis_calls":13,"redis_duration_s":0.0016319999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014561,"completed_at":"2026-09-01T10:36:08.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 280.419042] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6072da302ac68b513d98e674","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6072da302ac68b513d98e674: start","job_status":"start","queue_duration_s":1.406701,"scheduling_latency_s":1.406719}1494gitlab # [ 280.431435] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6072da302ac68b513d98e674","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6072da302ac68b513d98e674: done: 0.014714 sec","job_status":"done","queue_duration_s":1.406701,"scheduling_latency_s":1.406719,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014714,"completed_at":"2026-09-01T10:36:08.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 280.469960] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b7144ebddf42e63a160dbe","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b7144ebddf42e63a160dbe: start","job_status":"start","queue_duration_s":1.422446,"scheduling_latency_s":1.422463}1496gitlab # [ 280.482170] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b7144ebddf42e63a160dbe","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b7144ebddf42e63a160dbe: done: 0.015451 sec","job_status":"done","queue_duration_s":1.422446,"scheduling_latency_s":1.422463,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015451,"completed_at":"2026-09-01T10:36:08.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 280.520628] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e03f32e7d8bc717cac55df","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e03f32e7d8bc717cac55df: start","job_status":"start","queue_duration_s":1.43905,"scheduling_latency_s":1.439068}1498gitlab # [ 280.532764] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e03f32e7d8bc717cac55df","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e03f32e7d8bc717cac55df: done: 0.015034 sec","job_status":"done","queue_duration_s":1.43905,"scheduling_latency_s":1.439068,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015034,"completed_at":"2026-09-01T10:36:08.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 280.570855] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e43cc913e97cb383740d5e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e43cc913e97cb383740d5e: start","job_status":"start","queue_duration_s":1.45565,"scheduling_latency_s":1.455669}1500gitlab # [ 280.584291] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e43cc913e97cb383740d5e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e43cc913e97cb383740d5e: done: 0.015855 sec","job_status":"done","queue_duration_s":1.45565,"scheduling_latency_s":1.455669,"redis_calls":13,"redis_duration_s":0.002003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015855,"completed_at":"2026-09-01T10:36:08.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 280.622409] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48446beeb4313e8cf92b0c7e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48446beeb4313e8cf92b0c7e: start","job_status":"start","queue_duration_s":1.472877,"scheduling_latency_s":1.472897}1502gitlab # [ 280.635031] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48446beeb4313e8cf92b0c7e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48446beeb4313e8cf92b0c7e: done: 0.015534 sec","job_status":"done","queue_duration_s":1.472877,"scheduling_latency_s":1.472897,"redis_calls":13,"redis_duration_s":0.001636,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-09-01T10:36:08.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 280.673569] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4063c1403e46e55f71afacb6","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4063c1403e46e55f71afacb6: start","job_status":"start","queue_duration_s":1.489799,"scheduling_latency_s":1.489819}1504gitlab # [ 280.686254] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4063c1403e46e55f71afacb6","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4063c1403e46e55f71afacb6: done: 0.015635 sec","job_status":"done","queue_duration_s":1.489799,"scheduling_latency_s":1.489819,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015635,"completed_at":"2026-09-01T10:36:08.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 280.725037] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5068cd6fef4ab292376a074c","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5068cd6fef4ab292376a074c: start","job_status":"start","queue_duration_s":1.506856,"scheduling_latency_s":1.506876}1506gitlab # [ 280.737073] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5068cd6fef4ab292376a074c","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5068cd6fef4ab292376a074c: done: 0.016105 sec","job_status":"done","queue_duration_s":1.506856,"scheduling_latency_s":1.506876,"redis_calls":13,"redis_duration_s":0.0018110000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016105,"completed_at":"2026-09-01T10:36:08.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 280.776058] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedaf638e68991106e3c8bdb","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedaf638e68991106e3c8bdb: start","job_status":"start","queue_duration_s":1.524416,"scheduling_latency_s":1.524436}1508gitlab # [ 280.789156] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedaf638e68991106e3c8bdb","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedaf638e68991106e3c8bdb: done: 0.01625 sec","job_status":"done","queue_duration_s":1.524416,"scheduling_latency_s":1.524436,"redis_calls":13,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01625,"completed_at":"2026-09-01T10:36:08.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 280.828049] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3f48acf37193b554d11f313","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3f48acf37193b554d11f313: start","job_status":"start","queue_duration_s":1.541722,"scheduling_latency_s":1.54174}1510gitlab # [ 280.840237] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3f48acf37193b554d11f313","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3f48acf37193b554d11f313: done: 0.015009 sec","job_status":"done","queue_duration_s":1.541722,"scheduling_latency_s":1.54174,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-09-01T10:36:08.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 280.878756] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a536d7aa3e7d910ce83493","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a536d7aa3e7d910ce83493: start","job_status":"start","queue_duration_s":1.557796,"scheduling_latency_s":1.557812}1512gitlab # [ 280.891138] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a536d7aa3e7d910ce83493","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a536d7aa3e7d910ce83493: done: 0.014635 sec","job_status":"done","queue_duration_s":1.557796,"scheduling_latency_s":1.557812,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014635,"completed_at":"2026-09-01T10:36:08.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 280.929443] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830ced62a0f910079207309e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830ced62a0f910079207309e: start","job_status":"start","queue_duration_s":1.573509,"scheduling_latency_s":1.573527}1514gitlab # [ 280.941564] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"830ced62a0f910079207309e","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-830ced62a0f910079207309e: done: 0.014762 sec","job_status":"done","queue_duration_s":1.573509,"scheduling_latency_s":1.573527,"redis_calls":13,"redis_duration_s":0.001875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014762,"completed_at":"2026-09-01T10:36:08.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 280.980266] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9757633c5d905b7047189cae","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9757633c5d905b7047189cae: start","job_status":"start","queue_duration_s":1.589327,"scheduling_latency_s":1.589344}1516gitlab # [ 280.993068] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9757633c5d905b7047189cae","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9757633c5d905b7047189cae: done: 0.015129 sec","job_status":"done","queue_duration_s":1.589327,"scheduling_latency_s":1.589344,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015129,"completed_at":"2026-09-01T10:36:08.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 281.032087] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b151141962b403973d0b29","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b151141962b403973d0b29: start","job_status":"start","queue_duration_s":1.605509,"scheduling_latency_s":1.605526}1518gitlab # [ 281.044404] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b151141962b403973d0b29","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b151141962b403973d0b29: done: 0.014969 sec","job_status":"done","queue_duration_s":1.605509,"scheduling_latency_s":1.605526,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014969,"completed_at":"2026-09-01T10:36:08.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 281.083181] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c22a2fb21cb24dcf0dd6ec","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c22a2fb21cb24dcf0dd6ec: start","job_status":"start","queue_duration_s":1.621928,"scheduling_latency_s":1.621947}1520gitlab # [ 281.095769] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42c22a2fb21cb24dcf0dd6ec","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42c22a2fb21cb24dcf0dd6ec: done: 0.015947 sec","job_status":"done","queue_duration_s":1.621928,"scheduling_latency_s":1.621947,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015947,"completed_at":"2026-09-01T10:36:08.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 281.134925] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03cc0af97fdaf07e58fd60c","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03cc0af97fdaf07e58fd60c: start","job_status":"start","queue_duration_s":1.639298,"scheduling_latency_s":1.639317}1522gitlab # [ 281.147842] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03cc0af97fdaf07e58fd60c","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03cc0af97fdaf07e58fd60c: done: 0.015952 sec","job_status":"done","queue_duration_s":1.639298,"scheduling_latency_s":1.639317,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015952,"completed_at":"2026-09-01T10:36:08.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 281.186187] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cbe3d75af9aa0836af3ff9","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cbe3d75af9aa0836af3ff9: start","job_status":"start","queue_duration_s":1.65683,"scheduling_latency_s":1.656848}1524gitlab # [ 281.199160] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cbe3d75af9aa0836af3ff9","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cbe3d75af9aa0836af3ff9: done: 0.016258 sec","job_status":"done","queue_duration_s":1.65683,"scheduling_latency_s":1.656848,"redis_calls":13,"redis_duration_s":0.001811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016258,"completed_at":"2026-09-01T10:36:08.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 281.237364] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7112afd6f55f4eb4425f423d","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7112afd6f55f4eb4425f423d: start","job_status":"start","queue_duration_s":1.674519,"scheduling_latency_s":1.674538}1526gitlab # [ 281.249347] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7112afd6f55f4eb4425f423d","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7112afd6f55f4eb4425f423d: done: 0.016318 sec","job_status":"done","queue_duration_s":1.674519,"scheduling_latency_s":1.674538,"redis_calls":13,"redis_duration_s":0.001764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016318,"completed_at":"2026-09-01T10:36:08.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 281.287449] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"413b8748bb669730e2d83d1f","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-413b8748bb669730e2d83d1f: start","job_status":"start","queue_duration_s":1.692415,"scheduling_latency_s":1.692433}1528gitlab # [ 281.299958] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"413b8748bb669730e2d83d1f","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-413b8748bb669730e2d83d1f: done: 0.01475 sec","job_status":"done","queue_duration_s":1.692415,"scheduling_latency_s":1.692433,"redis_calls":13,"redis_duration_s":0.0014360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01475,"completed_at":"2026-09-01T10:36:08.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 281.338482] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c995dee8df30f261dbb08e1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c995dee8df30f261dbb08e1: start","job_status":"start","queue_duration_s":1.708217,"scheduling_latency_s":1.708235}1530gitlab # [ 281.350561] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c995dee8df30f261dbb08e1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c995dee8df30f261dbb08e1: done: 0.014848 sec","job_status":"done","queue_duration_s":1.708217,"scheduling_latency_s":1.708235,"redis_calls":13,"redis_duration_s":0.0016020000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014848,"completed_at":"2026-09-01T10:36:08.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 281.388999] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b508e9f672159941511ddc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b508e9f672159941511ddc: start","job_status":"start","queue_duration_s":1.724338,"scheduling_latency_s":1.724356}1532gitlab # [ 281.402170] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b508e9f672159941511ddc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b508e9f672159941511ddc: done: 0.015284 sec","job_status":"done","queue_duration_s":1.724338,"scheduling_latency_s":1.724356,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015284,"completed_at":"2026-09-01T10:36:08.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 281.440503] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ec4409c2b3b36c461c307e5","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ec4409c2b3b36c461c307e5: start","job_status":"start","queue_duration_s":1.74067,"scheduling_latency_s":1.740687}1534gitlab # [ 281.452460] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ec4409c2b3b36c461c307e5","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ec4409c2b3b36c461c307e5: done: 0.015503 sec","job_status":"done","queue_duration_s":1.74067,"scheduling_latency_s":1.740687,"redis_calls":13,"redis_duration_s":0.001585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015503,"completed_at":"2026-09-01T10:36:08.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 281.490622] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b9a791a0a49e72acc4aa5ac","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b9a791a0a49e72acc4aa5ac: start","job_status":"start","queue_duration_s":1.757617,"scheduling_latency_s":1.757635}1536gitlab # [ 281.502896] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b9a791a0a49e72acc4aa5ac","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b9a791a0a49e72acc4aa5ac: done: 0.016582 sec","job_status":"done","queue_duration_s":1.757617,"scheduling_latency_s":1.757635,"redis_calls":13,"redis_duration_s":0.0017950000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016582,"completed_at":"2026-09-01T10:36:08.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 281.541244] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75cb6866b790b9897908926","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75cb6866b790b9897908926: start","job_status":"start","queue_duration_s":1.775383,"scheduling_latency_s":1.7754}1538gitlab # [ 281.553256] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75cb6866b790b9897908926","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75cb6866b790b9897908926: done: 0.016608 sec","job_status":"done","queue_duration_s":1.775383,"scheduling_latency_s":1.7754,"redis_calls":13,"redis_duration_s":0.001747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016608,"completed_at":"2026-09-01T10:36:08.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 281.591251] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54fdab35097474d94a5371dc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54fdab35097474d94a5371dc: start","job_status":"start","queue_duration_s":1.793157,"scheduling_latency_s":1.793176}1540gitlab # [ 281.604906] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54fdab35097474d94a5371dc","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54fdab35097474d94a5371dc: done: 0.015703 sec","job_status":"done","queue_duration_s":1.793157,"scheduling_latency_s":1.793176,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-09-01T10:36:08.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 281.642975] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d819a5d368936c3c95700548","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d819a5d368936c3c95700548: start","job_status":"start","queue_duration_s":1.810067,"scheduling_latency_s":1.810084}1542gitlab # [ 281.655260] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d819a5d368936c3c95700548","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d819a5d368936c3c95700548: done: 0.014644 sec","job_status":"done","queue_duration_s":1.810067,"scheduling_latency_s":1.810084,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014644,"completed_at":"2026-09-01T10:36:08.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 281.693401] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e00f554920828501b62ed25","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e00f554920828501b62ed25: start","job_status":"start","queue_duration_s":1.825942,"scheduling_latency_s":1.825959}1544gitlab # [ 281.705512] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e00f554920828501b62ed25","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e00f554920828501b62ed25: done: 0.01509 sec","job_status":"done","queue_duration_s":1.825942,"scheduling_latency_s":1.825959,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01509,"completed_at":"2026-09-01T10:36:08.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 281.743875] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f92050b3d1884fd480edf2","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f92050b3d1884fd480edf2: start","job_status":"start","queue_duration_s":1.842398,"scheduling_latency_s":1.842415}1546gitlab # [ 281.756146] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f92050b3d1884fd480edf2","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f92050b3d1884fd480edf2: done: 0.014627 sec","job_status":"done","queue_duration_s":1.842398,"scheduling_latency_s":1.842415,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014627,"completed_at":"2026-09-01T10:36:08.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 281.794267] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd30de79fe71abfa699c0b1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd30de79fe71abfa699c0b1: start","job_status":"start","queue_duration_s":1.858294,"scheduling_latency_s":1.858311}1548gitlab # [ 281.807295] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd30de79fe71abfa699c0b1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd30de79fe71abfa699c0b1: done: 0.014633 sec","job_status":"done","queue_duration_s":1.858294,"scheduling_latency_s":1.858311,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014633,"completed_at":"2026-09-01T10:36:08.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 281.846515] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b9b7f812d39c74f832140c1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b9b7f812d39c74f832140c1: start","job_status":"start","queue_duration_s":1.874163,"scheduling_latency_s":1.874179}1550gitlab # [ 281.884266] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b9b7f812d39c74f832140c1","created_at":"2026-09-01T10:36:06.649Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-72e504ae82824b0c","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b85a3c5ee9c1337c932a4d6f09f1626","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:06.807Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b9b7f812d39c74f832140c1: done: 0.014824 sec","job_status":"done","queue_duration_s":1.874163,"scheduling_latency_s":1.874179,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014824,"completed_at":"2026-09-01T10:36:08.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 281.952379] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"8df6e076de865bcebe175097","created_at":"2026-09-01T10:36:07.597Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-a9b8e9f83c61442b","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"3adb7b8ebf8c8e76a151653e5609df8e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.607Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-8df6e076de865bcebe175097: start","job_status":"start","queue_duration_s":1.08986,"scheduling_latency_s":1.089877}1552gitlab # [ 281.966773] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"8df6e076de865bcebe175097","created_at":"2026-09-01T10:36:07.597Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-a9b8e9f83c61442b","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"3adb7b8ebf8c8e76a151653e5609df8e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.607Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-8df6e076de865bcebe175097: done: 0.034293 sec","job_status":"done","queue_duration_s":1.08986,"scheduling_latency_s":1.089877,"redis_calls":13,"redis_duration_s":0.001786,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024428,"duration_s":0.034293,"completed_at":"2026-09-01T10:36:08.731Z","load_balancing_strategy":"primary","db_duration_s":0.004091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 282.008165] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.733Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d1ec0972772fb3c8f55080d","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d1ec0972772fb3c8f55080d: start","job_status":"start","queue_duration_s":1.079039,"scheduling_latency_s":1.079056}1554gitlab # [ 282.021891] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.744Z","message":"No existing merge request to be cleaned up."}1555gitlab # [ 282.023661] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.753Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d1ec0972772fb3c8f55080d","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d1ec0972772fb3c8f55080d: done: 0.020345 sec","job_status":"done","queue_duration_s":1.079039,"scheduling_latency_s":1.079056,"redis_calls":10,"redis_duration_s":0.001411,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020345,"completed_at":"2026-09-01T10:36:08.753Z","load_balancing_strategy":"primary","db_duration_s":0.001577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 282.091502] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.754Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db5d050706e16ab21060e8e","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db5d050706e16ab21060e8e: start","job_status":"start","queue_duration_s":1.100509,"scheduling_latency_s":1.100526}1557gitlab # [ 282.114134] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.765Z","message":"No existing merge request to be cleaned up."}1558gitlab # [ 282.116816] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.773Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8db5d050706e16ab21060e8e","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8db5d050706e16ab21060e8e: done: 0.018888 sec","job_status":"done","queue_duration_s":1.100509,"scheduling_latency_s":1.100526,"redis_calls":10,"redis_duration_s":0.001369,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018888,"completed_at":"2026-09-01T10:36:08.773Z","load_balancing_strategy":"primary","db_duration_s":0.001341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 282.163448] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.774Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"55713c97bd0aa5ce1155c882","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-55713c97bd0aa5ce1155c882: start","job_status":"start","queue_duration_s":1.120732,"scheduling_latency_s":1.120749}1560gitlab # [ 282.175654] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.785Z","message":"No existing merge request to be cleaned up."}1561gitlab # [ 282.177587] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.793Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"55713c97bd0aa5ce1155c882","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-55713c97bd0aa5ce1155c882: done: 0.019087 sec","job_status":"done","queue_duration_s":1.120732,"scheduling_latency_s":1.120749,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000842,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019087,"completed_at":"2026-09-01T10:36:08.793Z","load_balancing_strategy":"primary","db_duration_s":0.001353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 282.215611] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e0542676d3525fd8952bd87","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e0542676d3525fd8952bd87: start","job_status":"start","queue_duration_s":1.141158,"scheduling_latency_s":1.141178}1563gitlab # [ 282.228981] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.806Z","message":"No existing merge request to be cleaned up."}1564gitlab # [ 282.230633] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:36:08.815Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e0542676d3525fd8952bd87","created_at":"2026-09-01T10:36:07.644Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-aa33791bef464bb8","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0c2d5a99992aaa311f63e66947666643","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:07.654Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e0542676d3525fd8952bd87: done: 0.019892 sec","job_status":"done","queue_duration_s":1.141158,"scheduling_latency_s":1.141178,"redis_calls":10,"redis_duration_s":0.001522,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019892,"completed_at":"2026-09-01T10:36:08.815Z","load_balancing_strategy":"primary","db_duration_s":0.001624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 296.506808] setup-gitlab-start[3094]: W, [2026-09-01T10:36:27.280119 #3094] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1566gitlab # [ 309.304224] redis[796]: 10 changes in 300 seconds. Saving...1567gitlab # [ 309.310081] redis[796]: Background saving started by pid 33571568gitlab # [ 309.317897] redis[3357]: BGSAVE done, 485 keys saved, 0 keys skipped, 123539 bytes written.1569gitlab # [ 309.323400] redis[3357]: DB saved on disk1570gitlab # [ 309.325735] redis[3357]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1571gitlab # [ 309.405432] redis[796]: Background saving terminated with success1572gitlab # [ 310.903357] postgres[862]: [862] LOG: checkpoint starting: time1573gitlab # [ 312.386809] gitaly[894]: time="2026-09-01T10:36:43.159Z" level=info msg="burden monitor stats" pid=8941574gitlab # [ 331.284469] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:02.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4365588589f3fa856bdcdfd6","created_at":"2026-09-01T10:37:01.968Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36f551404c64d1390c45c4657e2ead24","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.052Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4365588589f3fa856bdcdfd6: start","job_status":"start","queue_duration_s":0.003942,"scheduling_latency_s":0.004001}1575gitlab # [ 332.672538] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4365588589f3fa856bdcdfd6","created_at":"2026-09-01T10:37:01.968Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36f551404c64d1390c45c4657e2ead24","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.052Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4365588589f3fa856bdcdfd6: done: 1.388723 sec","job_status":"done","queue_duration_s":0.003942,"scheduling_latency_s":0.004001,"redis_calls":569,"redis_duration_s":0.755457,"redis_read_bytes":1456,"redis_write_bytes":49243,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.003043,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":483,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.750187,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.655405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.388723,"completed_at":"2026-09-01T10:37:03.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 332.673592] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a2f4fc5675694d69b88a1b13","created_at":"2026-09-01T10:37:02.071Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00f747d8e8cd43163da4809342be81a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.082Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a2f4fc5675694d69b88a1b13: start","job_status":"start","queue_duration_s":1.36517,"scheduling_latency_s":1.365204}1577gitlab # [ 332.764712] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.458Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1578gitlab # [ 332.764804] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a2f4fc5675694d69b88a1b13","created_at":"2026-09-01T10:37:02.071Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00f747d8e8cd43163da4809342be81a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.082Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a2f4fc5675694d69b88a1b13: done: 0.017555 sec","job_status":"done","queue_duration_s":1.36517,"scheduling_latency_s":1.365204,"redis_calls":8,"redis_duration_s":0.001432,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000155,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000378,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017555,"completed_at":"2026-09-01T10:37:03.465Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 333.483287] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f38dbcdfb6b1be007c237675","created_at":"2026-09-01T10:37:02.105Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc1d81704ba12197084d911c9750a4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.121Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f38dbcdfb6b1be007c237675: start","job_status":"start","queue_duration_s":1.345501,"scheduling_latency_s":1.345526}1580gitlab # [ 333.483452] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.478Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1581gitlab # [ 333.483718] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f38dbcdfb6b1be007c237675","created_at":"2026-09-01T10:37:02.105Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc1d81704ba12197084d911c9750a4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.121Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f38dbcdfb6b1be007c237675: done: 0.01804 sec","job_status":"done","queue_duration_s":1.345501,"scheduling_latency_s":1.345526,"redis_calls":8,"redis_duration_s":0.001625,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000156,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01804,"completed_at":"2026-09-01T10:37:03.484Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 334.157156] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8c6a44e25fa176ad06eca516","created_at":"2026-09-01T10:37:02.197Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fed4277d598cba05575c9dcedf4593b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.214Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8c6a44e25fa176ad06eca516: start","job_status":"start","queue_duration_s":1.272736,"scheduling_latency_s":1.27276}1583gitlab # [ 334.157372] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8c6a44e25fa176ad06eca516","created_at":"2026-09-01T10:37:02.197Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fed4277d598cba05575c9dcedf4593b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.214Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8c6a44e25fa176ad06eca516: done: 0.062831 sec","job_status":"done","queue_duration_s":1.272736,"scheduling_latency_s":1.27276,"redis_calls":9,"redis_duration_s":0.001724,"redis_read_bytes":261,"redis_write_bytes":985,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":159,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.062831,"completed_at":"2026-09-01T10:37:03.550Z","load_balancing_strategy":"primary","db_duration_s":0.041704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 334.876807] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"279462da4cc9e6872b67c855","created_at":"2026-09-01T10:37:02.236Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"150d942c548a61d1531e0e8855e76560","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.253Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-279462da4cc9e6872b67c855: start","job_status":"start","queue_duration_s":1.298427,"scheduling_latency_s":1.298453}1585gitlab # [ 335.564460] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"279462da4cc9e6872b67c855","created_at":"2026-09-01T10:37:02.236Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"150d942c548a61d1531e0e8855e76560","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.253Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-279462da4cc9e6872b67c855: done: 0.023529 sec","job_status":"done","queue_duration_s":1.298427,"scheduling_latency_s":1.298453,"redis_calls":10,"redis_duration_s":0.0026320000000000002,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000142,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061858,"exclusive_lock_hold_duration_s":0.00493764,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023529,"completed_at":"2026-09-01T10:37:03.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 336.278759] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"175cb3ed0fd9b3be1e8d5c21","created_at":"2026-09-01T10:37:02.277Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cffbd7ae6d832da86245d21a61603974","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.294Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-175cb3ed0fd9b3be1e8d5c21: start","job_status":"start","queue_duration_s":1.282824,"scheduling_latency_s":1.282849}1587gitlab # [ 336.279002] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"175cb3ed0fd9b3be1e8d5c21","created_at":"2026-09-01T10:37:02.277Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cffbd7ae6d832da86245d21a61603974","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.294Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-175cb3ed0fd9b3be1e8d5c21: done: 0.024085 sec","job_status":"done","queue_duration_s":1.282824,"scheduling_latency_s":1.282849,"redis_calls":10,"redis_duration_s":0.003129,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006855,"exclusive_lock_hold_duration_s":0.00394324,"duration_s":0.024085,"completed_at":"2026-09-01T10:37:03.601Z","load_balancing_strategy":"primary","db_duration_s":0.001023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 336.907765] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cf6e392723714f513332e7d5","created_at":"2026-09-01T10:37:02.329Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51872f0a374005f8868a0857ac26ccf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:37:02.343Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cf6e392723714f513332e7d5: start","job_status":"start","queue_duration_s":1.259942,"scheduling_latency_s":1.259964}1589gitlab # [ 336.907872] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.614Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1590gitlab # [ 336.908057] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cf6e392723714f513332e7d5","created_at":"2026-09-01T10:37:02.329Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51872f0a374005f8868a0857ac26ccf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:37:02.343Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cf6e392723714f513332e7d5: done: 0.016413 sec","job_status":"done","queue_duration_s":1.259942,"scheduling_latency_s":1.259964,"redis_calls":8,"redis_duration_s":0.002002,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016413,"completed_at":"2026-09-01T10:37:03.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 337.596681] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"db32cc058aecb826fbdd41ec","created_at":"2026-09-01T10:37:02.376Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.389Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-db32cc058aecb826fbdd41ec: start","job_status":"start","queue_duration_s":1.232891,"scheduling_latency_s":1.232911}1592gitlab # [ 337.596968] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"db32cc058aecb826fbdd41ec","created_at":"2026-09-01T10:37:02.376Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.389Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-db32cc058aecb826fbdd41ec: done: 0.109993 sec","job_status":"done","queue_duration_s":1.232891,"scheduling_latency_s":1.232911,"redis_calls":65,"redis_duration_s":0.019068,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.002123,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000989,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01518,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109993,"completed_at":"2026-09-01T10:37:03.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 338.202843] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e171d996a468f98cf25188b3","created_at":"2026-09-01T10:37:02.416Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac3b4796d973a42b5e093d47ac7639c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.434Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e171d996a468f98cf25188b3: start","job_status":"start","queue_duration_s":1.299911,"scheduling_latency_s":1.299935}1594gitlab # [ 338.821121] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e171d996a468f98cf25188b3","created_at":"2026-09-01T10:37:02.416Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac3b4796d973a42b5e093d47ac7639c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.434Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e171d996a468f98cf25188b3: done: 0.025926 sec","job_status":"done","queue_duration_s":1.299911,"scheduling_latency_s":1.299935,"redis_calls":11,"redis_duration_s":0.0031060000000000003,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00630714,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.025926,"completed_at":"2026-09-01T10:37:03.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1595gitlab # [ 339.499515] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f86e7bd75f7af092d40a69ae","created_at":"2026-09-01T10:37:02.467Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19b83660496e988b2ee933d825d45756","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:37:02.481Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f86e7bd75f7af092d40a69ae: start","job_status":"start","queue_duration_s":1.280053,"scheduling_latency_s":1.280073}1596gitlab # [ 339.499718] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f86e7bd75f7af092d40a69ae","created_at":"2026-09-01T10:37:02.467Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19b83660496e988b2ee933d825d45756","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:37:02.481Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f86e7bd75f7af092d40a69ae: done: 0.025173 sec","job_status":"done","queue_duration_s":1.280053,"scheduling_latency_s":1.280073,"redis_calls":9,"redis_duration_s":0.002295,"redis_read_bytes":261,"redis_write_bytes":906,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":165,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025173,"completed_at":"2026-09-01T10:37:03.786Z","load_balancing_strategy":"primary","db_duration_s":0.001444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 340.220676] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:03.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f8b3a93421cd010743c34974","created_at":"2026-09-01T10:37:02.524Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4d5ca53c9858788ad906f0962d6d7cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.536Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f8b3a93421cd010743c34974: start","job_status":"start","queue_duration_s":1.251698,"scheduling_latency_s":1.251717}1598gitlab # [ 340.220927] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f8b3a93421cd010743c34974","created_at":"2026-09-01T10:37:02.524Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4d5ca53c9858788ad906f0962d6d7cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.536Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f8b3a93421cd010743c34974: done: 0.379834 sec","job_status":"done","queue_duration_s":1.251698,"scheduling_latency_s":1.251717,"redis_calls":11,"redis_duration_s":0.0038120000000000003,"redis_read_bytes":263,"redis_write_bytes":1138,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.307127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058592,"exclusive_lock_hold_duration_s":0.35319664,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.379834,"completed_at":"2026-09-01T10:37:04.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 340.942645] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"22ccb0482a7b04ec8e2ac86f","created_at":"2026-09-01T10:37:02.555Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efe6d7a816317adafc28f98d2104034f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.568Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-22ccb0482a7b04ec8e2ac86f: start","job_status":"start","queue_duration_s":1.603743,"scheduling_latency_s":1.603792}1600gitlab # [ 341.670399] postgres[3456]: [3456] ERROR: relation "table_without_models" does not exist1601gitlab # [ 341.670548] postgres[3456]: [3456] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1602gitlab # [ 341.670660] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"22ccb0482a7b04ec8e2ac86f","created_at":"2026-09-01T10:37:02.555Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efe6d7a816317adafc28f98d2104034f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.568Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-22ccb0482a7b04ec8e2ac86f: done: 0.091645 sec","job_status":"done","queue_duration_s":1.603743,"scheduling_latency_s":1.603792,"redis_calls":10,"redis_duration_s":0.005937,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00178806,"exclusive_lock_hold_duration_s":0.03067012,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.091645,"completed_at":"2026-09-01T10:37:04.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 342.341131] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f9d2e78ae99f0acc13ec1535","created_at":"2026-09-01T10:37:02.601Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ece5b8fe0ed8e47d692512348d37eb0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.614Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f9d2e78ae99f0acc13ec1535: start","job_status":"start","queue_duration_s":1.654372,"scheduling_latency_s":1.654474}1604gitlab # [ 342.383432] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f9d2e78ae99f0acc13ec1535","created_at":"2026-09-01T10:37:02.601Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ece5b8fe0ed8e47d692512348d37eb0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.614Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f9d2e78ae99f0acc13ec1535: done: 0.037341 sec","job_status":"done","queue_duration_s":1.654372,"scheduling_latency_s":1.654474,"redis_calls":9,"redis_duration_s":0.0035819999999999997,"redis_read_bytes":261,"redis_write_bytes":944,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":168,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037341,"completed_at":"2026-09-01T10:37:04.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 342.450771] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"30bdfa357b909241fc772036","created_at":"2026-09-01T10:37:02.651Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.665Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-30bdfa357b909241fc772036: start","job_status":"start","queue_duration_s":1.644092,"scheduling_latency_s":1.644132}1606gitlab # [ 342.466341] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"30bdfa357b909241fc772036","created_at":"2026-09-01T10:37:02.651Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.665Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-30bdfa357b909241fc772036: done: 0.048615 sec","job_status":"done","queue_duration_s":1.644092,"scheduling_latency_s":1.644132,"redis_calls":16,"redis_duration_s":0.007102,"redis_read_bytes":272,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000475,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004879,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048615,"completed_at":"2026-09-01T10:37:04.357Z","load_balancing_strategy":"primary","db_duration_s":0.001314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 342.515389] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"639bf7921e9fcc9cd19af353","created_at":"2026-09-01T10:37:02.700Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"174559ee12aca27cf690264c451b6588","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.715Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-639bf7921e9fcc9cd19af353: start","job_status":"start","queue_duration_s":1.644823,"scheduling_latency_s":1.644856}1608gitlab # [ 342.530368] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"639bf7921e9fcc9cd19af353","created_at":"2026-09-01T10:37:02.700Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"174559ee12aca27cf690264c451b6588","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.715Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-639bf7921e9fcc9cd19af353: done: 0.057413 sec","job_status":"done","queue_duration_s":1.644823,"scheduling_latency_s":1.644856,"redis_calls":10,"redis_duration_s":0.003308,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078,"exclusive_lock_hold_duration_s":0.03218914,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.057413,"completed_at":"2026-09-01T10:37:04.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 342.573747] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"db2404c222d92a307a39d3e2","created_at":"2026-09-01T10:37:02.766Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32fa042bee2d5f898c8ed24cae321c03","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.778Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-db2404c222d92a307a39d3e2: start","job_status":"start","queue_duration_s":1.641555,"scheduling_latency_s":1.641585}1610gitlab # [ 342.588084] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"db2404c222d92a307a39d3e2","created_at":"2026-09-01T10:37:02.766Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32fa042bee2d5f898c8ed24cae321c03","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.778Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-db2404c222d92a307a39d3e2: done: 0.020762 sec","job_status":"done","queue_duration_s":1.641555,"scheduling_latency_s":1.641585,"redis_calls":8,"redis_duration_s":0.002319,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020762,"completed_at":"2026-09-01T10:37:04.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 342.628990] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b94189bc5052574a8b85ae51","created_at":"2026-09-01T10:37:02.834Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaa2760ae0ba641cfa1f428bd16345bf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.847Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b94189bc5052574a8b85ae51: start","job_status":"start","queue_duration_s":1.595386,"scheduling_latency_s":1.595412}1612gitlab # [ 342.642788] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b94189bc5052574a8b85ae51","created_at":"2026-09-01T10:37:02.834Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aaa2760ae0ba641cfa1f428bd16345bf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.847Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b94189bc5052574a8b85ae51: done: 0.020506 sec","job_status":"done","queue_duration_s":1.595386,"scheduling_latency_s":1.595412,"redis_calls":8,"redis_duration_s":0.002415,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020506,"completed_at":"2026-09-01T10:37:04.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 342.684662] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bb29bbf02703b187d9e49d93","created_at":"2026-09-01T10:37:02.890Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e9ab19ef75daacf66b7b623c83266b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:37:02.901Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bb29bbf02703b187d9e49d93: start","job_status":"start","queue_duration_s":1.563146,"scheduling_latency_s":1.563169}1614gitlab # [ 342.697680] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.475Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1615gitlab # [ 342.700948] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bb29bbf02703b187d9e49d93","created_at":"2026-09-01T10:37:02.890Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e9ab19ef75daacf66b7b623c83266b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:37:02.901Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bb29bbf02703b187d9e49d93: done: 0.016679 sec","job_status":"done","queue_duration_s":1.563146,"scheduling_latency_s":1.563169,"redis_calls":8,"redis_duration_s":0.002062,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016679,"completed_at":"2026-09-01T10:37:04.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 342.740799] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c1091f097759271557239212","created_at":"2026-09-01T10:37:02.922Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a70a4c840028681f83f0b73d578eeb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.934Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c1091f097759271557239212: start","job_status":"start","queue_duration_s":1.548672,"scheduling_latency_s":1.548692}1617gitlab # [ 342.755020] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.492Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1618gitlab # [ 342.758804] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c1091f097759271557239212","created_at":"2026-09-01T10:37:02.922Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a70a4c840028681f83f0b73d578eeb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.934Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c1091f097759271557239212: done: 0.01546 sec","job_status":"done","queue_duration_s":1.548672,"scheduling_latency_s":1.548692,"redis_calls":8,"redis_duration_s":0.001962,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000223,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01546,"completed_at":"2026-09-01T10:37:04.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 342.799835] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dbc2aa79d5838b6296296ba4","created_at":"2026-09-01T10:37:03.027Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1df9def925090e7da75aa5efc99ea531","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.041Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dbc2aa79d5838b6296296ba4: start","job_status":"start","queue_duration_s":1.458652,"scheduling_latency_s":1.458671}1620gitlab # [ 342.813798] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dbc2aa79d5838b6296296ba4","created_at":"2026-09-01T10:37:03.027Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1df9def925090e7da75aa5efc99ea531","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.041Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dbc2aa79d5838b6296296ba4: done: 0.028703 sec","job_status":"done","queue_duration_s":1.458652,"scheduling_latency_s":1.458671,"redis_calls":11,"redis_duration_s":0.003094,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001188,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028703,"completed_at":"2026-09-01T10:37:04.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 342.854492] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9ac5f58e3167f6d982f06150","created_at":"2026-09-01T10:37:03.062Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aa997f9fa8287eeb512fdcefc43d83b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.074Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9ac5f58e3167f6d982f06150: start","job_status":"start","queue_duration_s":1.456501,"scheduling_latency_s":1.456524}1622gitlab # [ 342.868560] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.539Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1623gitlab # [ 342.871967] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9ac5f58e3167f6d982f06150","created_at":"2026-09-01T10:37:03.062Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-71c0c60285c742d9","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aa997f9fa8287eeb512fdcefc43d83b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.074Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9ac5f58e3167f6d982f06150: done: 0.014859 sec","job_status":"done","queue_duration_s":1.456501,"scheduling_latency_s":1.456524,"redis_calls":8,"redis_duration_s":0.001989,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014859,"completed_at":"2026-09-01T10:37:04.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 342.914482] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c913161af28607601a0ecea","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c913161af28607601a0ecea: start","job_status":"start","queue_duration_s":0.823966,"scheduling_latency_s":0.823983}1625gitlab # [ 342.926572] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c913161af28607601a0ecea","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c913161af28607601a0ecea: done: 0.022584 sec","job_status":"done","queue_duration_s":0.823966,"scheduling_latency_s":0.823983,"redis_calls":14,"redis_duration_s":0.004262,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000764,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022584,"completed_at":"2026-09-01T10:37:04.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 342.966495] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75c20c46e013dcb585f5f7e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75c20c46e013dcb585f5f7e: start","job_status":"start","queue_duration_s":0.850193,"scheduling_latency_s":0.850238}1627gitlab # [ 342.978649] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75c20c46e013dcb585f5f7e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75c20c46e013dcb585f5f7e: done: 0.038721 sec","job_status":"done","queue_duration_s":0.850193,"scheduling_latency_s":0.850238,"redis_calls":13,"redis_duration_s":0.003784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002507,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038721,"completed_at":"2026-09-01T10:37:04.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 343.016709] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af487d3fc45133b7383313b5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af487d3fc45133b7383313b5: start","job_status":"start","queue_duration_s":0.892711,"scheduling_latency_s":0.892749}1629gitlab # [ 343.028717] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af487d3fc45133b7383313b5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af487d3fc45133b7383313b5: done: 0.030841 sec","job_status":"done","queue_duration_s":0.892711,"scheduling_latency_s":0.892749,"redis_calls":13,"redis_duration_s":0.0037660000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030841,"completed_at":"2026-09-01T10:37:04.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 343.066836] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27abbb29a3a5f984a982af89","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27abbb29a3a5f984a982af89: start","job_status":"start","queue_duration_s":0.92577,"scheduling_latency_s":0.925798}1631gitlab # [ 343.078935] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27abbb29a3a5f984a982af89","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27abbb29a3a5f984a982af89: done: 0.026133 sec","job_status":"done","queue_duration_s":0.92577,"scheduling_latency_s":0.925798,"redis_calls":13,"redis_duration_s":0.0035580000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026133,"completed_at":"2026-09-01T10:37:04.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 343.119422] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf8153b680bfa1345344e2b8","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf8153b680bfa1345344e2b8: start","job_status":"start","queue_duration_s":0.954064,"scheduling_latency_s":0.954091}1633gitlab # [ 343.131730] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf8153b680bfa1345344e2b8","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf8153b680bfa1345344e2b8: done: 0.022975 sec","job_status":"done","queue_duration_s":0.954064,"scheduling_latency_s":0.954091,"redis_calls":13,"redis_duration_s":0.003356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022975,"completed_at":"2026-09-01T10:37:04.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 343.170931] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"708908691d5b27b9ad3fa6cb","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-708908691d5b27b9ad3fa6cb: start","job_status":"start","queue_duration_s":0.97957,"scheduling_latency_s":0.979592}1635gitlab # [ 343.183382] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"708908691d5b27b9ad3fa6cb","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-708908691d5b27b9ad3fa6cb: done: 0.029944 sec","job_status":"done","queue_duration_s":0.97957,"scheduling_latency_s":0.979592,"redis_calls":13,"redis_duration_s":0.00466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029944,"completed_at":"2026-09-01T10:37:04.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 343.221662] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2769e7e3c50e882b8a812fd3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2769e7e3c50e882b8a812fd3: start","job_status":"start","queue_duration_s":1.013032,"scheduling_latency_s":1.013077}1637gitlab # [ 343.233690] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2769e7e3c50e882b8a812fd3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2769e7e3c50e882b8a812fd3: done: 0.040548 sec","job_status":"done","queue_duration_s":1.013032,"scheduling_latency_s":1.013077,"redis_calls":13,"redis_duration_s":0.004861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040548,"completed_at":"2026-09-01T10:37:04.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 343.271353] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1482a658ce39f6de9b7c4ac","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1482a658ce39f6de9b7c4ac: start","job_status":"start","queue_duration_s":1.05665,"scheduling_latency_s":1.056692}1639gitlab # [ 343.283432] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1482a658ce39f6de9b7c4ac","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1482a658ce39f6de9b7c4ac: done: 0.031155 sec","job_status":"done","queue_duration_s":1.05665,"scheduling_latency_s":1.056692,"redis_calls":13,"redis_duration_s":0.0037730000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002477,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031155,"completed_at":"2026-09-01T10:37:04.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 343.322490] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33494890d51fad8bae8d2e5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33494890d51fad8bae8d2e5: start","job_status":"start","queue_duration_s":1.089884,"scheduling_latency_s":1.089913}1641gitlab # [ 343.334248] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e33494890d51fad8bae8d2e5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e33494890d51fad8bae8d2e5: done: 0.023195 sec","job_status":"done","queue_duration_s":1.089884,"scheduling_latency_s":1.089913,"redis_calls":13,"redis_duration_s":0.0031940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023195,"completed_at":"2026-09-01T10:37:04.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 343.372810] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e71498d7ca17eb3a7227bf33","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e71498d7ca17eb3a7227bf33: start","job_status":"start","queue_duration_s":1.11493,"scheduling_latency_s":1.114956}1643gitlab # [ 343.384491] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e71498d7ca17eb3a7227bf33","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e71498d7ca17eb3a7227bf33: done: 0.01934 sec","job_status":"done","queue_duration_s":1.11493,"scheduling_latency_s":1.114956,"redis_calls":13,"redis_duration_s":0.0036839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002696,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01934,"completed_at":"2026-09-01T10:37:04.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 343.422377] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d834d4b3fc0d1e032d041a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d834d4b3fc0d1e032d041a: start","job_status":"start","queue_duration_s":1.136511,"scheduling_latency_s":1.13654}1645gitlab # [ 343.434477] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d834d4b3fc0d1e032d041a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d834d4b3fc0d1e032d041a: done: 0.01855 sec","job_status":"done","queue_duration_s":1.136511,"scheduling_latency_s":1.13654,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01855,"completed_at":"2026-09-01T10:37:04.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 343.472119] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b01381be72d1d55e64c9ec4f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b01381be72d1d55e64c9ec4f: start","job_status":"start","queue_duration_s":1.156742,"scheduling_latency_s":1.156766}1647gitlab # [ 343.484090] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b01381be72d1d55e64c9ec4f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b01381be72d1d55e64c9ec4f: done: 0.042803 sec","job_status":"done","queue_duration_s":1.156742,"scheduling_latency_s":1.156766,"redis_calls":13,"redis_duration_s":0.005201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003343,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042803,"completed_at":"2026-09-01T10:37:04.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 343.522640] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62ba47110edfebbd8c48da3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62ba47110edfebbd8c48da3: start","job_status":"start","queue_duration_s":1.203787,"scheduling_latency_s":1.203837}1649gitlab # [ 343.534865] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62ba47110edfebbd8c48da3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62ba47110edfebbd8c48da3: done: 0.035418 sec","job_status":"done","queue_duration_s":1.203787,"scheduling_latency_s":1.203837,"redis_calls":13,"redis_duration_s":0.004139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035418,"completed_at":"2026-09-01T10:37:04.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 343.572318] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd63d06c2de2cdd6a3ec5008","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd63d06c2de2cdd6a3ec5008: start","job_status":"start","queue_duration_s":1.241446,"scheduling_latency_s":1.241481}1651gitlab # [ 343.584277] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd63d06c2de2cdd6a3ec5008","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd63d06c2de2cdd6a3ec5008: done: 0.023206 sec","job_status":"done","queue_duration_s":1.241446,"scheduling_latency_s":1.241481,"redis_calls":13,"redis_duration_s":0.003236,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023206,"completed_at":"2026-09-01T10:37:04.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 343.622619] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:04.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20010e0d61c6034b6af0d14d","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20010e0d61c6034b6af0d14d: start","job_status":"start","queue_duration_s":1.266288,"scheduling_latency_s":1.266308}1653gitlab # [ 343.635035] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20010e0d61c6034b6af0d14d","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20010e0d61c6034b6af0d14d: done: 0.019984 sec","job_status":"done","queue_duration_s":1.266288,"scheduling_latency_s":1.266308,"redis_calls":14,"redis_duration_s":0.00331,"redis_read_bytes":138,"redis_write_bytes":1221,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019984,"completed_at":"2026-09-01T10:37:05.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 343.675341] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ab555c22b47a1acd446868","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ab555c22b47a1acd446868: start","job_status":"start","queue_duration_s":1.287816,"scheduling_latency_s":1.287835}1655gitlab # [ 343.687838] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ab555c22b47a1acd446868","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ab555c22b47a1acd446868: done: 0.018047 sec","job_status":"done","queue_duration_s":1.287816,"scheduling_latency_s":1.287835,"redis_calls":13,"redis_duration_s":0.0029059999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018047,"completed_at":"2026-09-01T10:37:05.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 343.728136] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba53f07ec55bb498e474f56","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba53f07ec55bb498e474f56: start","job_status":"start","queue_duration_s":1.30735,"scheduling_latency_s":1.307367}1657gitlab # [ 343.740441] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bba53f07ec55bb498e474f56","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bba53f07ec55bb498e474f56: done: 0.017082 sec","job_status":"done","queue_duration_s":1.30735,"scheduling_latency_s":1.307367,"redis_calls":13,"redis_duration_s":0.0028669999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017082,"completed_at":"2026-09-01T10:37:05.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 343.778928] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1265e5ad35fae8eeba5d289a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1265e5ad35fae8eeba5d289a: start","job_status":"start","queue_duration_s":1.325831,"scheduling_latency_s":1.325847}1659gitlab # [ 343.791330] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1265e5ad35fae8eeba5d289a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1265e5ad35fae8eeba5d289a: done: 0.01758 sec","job_status":"done","queue_duration_s":1.325831,"scheduling_latency_s":1.325847,"redis_calls":13,"redis_duration_s":0.003564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01758,"completed_at":"2026-09-01T10:37:05.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 343.830227] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e388ff8020c5f6ef292dc57","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e388ff8020c5f6ef292dc57: start","job_status":"start","queue_duration_s":1.344906,"scheduling_latency_s":1.344922}1661gitlab # [ 343.842410] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e388ff8020c5f6ef292dc57","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e388ff8020c5f6ef292dc57: done: 0.016454 sec","job_status":"done","queue_duration_s":1.344906,"scheduling_latency_s":1.344922,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016454,"completed_at":"2026-09-01T10:37:05.084Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 343.881234] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bded91f3bcbe65741a05045e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bded91f3bcbe65741a05045e: start","job_status":"start","queue_duration_s":1.362831,"scheduling_latency_s":1.362848}1663gitlab # [ 343.893252] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bded91f3bcbe65741a05045e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bded91f3bcbe65741a05045e: done: 0.016923 sec","job_status":"done","queue_duration_s":1.362831,"scheduling_latency_s":1.362848,"redis_calls":13,"redis_duration_s":0.002927,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016923,"completed_at":"2026-09-01T10:37:05.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 343.933684] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcf4128b40b2a1b0a422e11","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcf4128b40b2a1b0a422e11: start","job_status":"start","queue_duration_s":1.381236,"scheduling_latency_s":1.381251}1665gitlab # [ 343.970352] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcf4128b40b2a1b0a422e11","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcf4128b40b2a1b0a422e11: done: 0.015816 sec","job_status":"done","queue_duration_s":1.381236,"scheduling_latency_s":1.381251,"redis_calls":13,"redis_duration_s":0.002799,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015816,"completed_at":"2026-09-01T10:37:05.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 344.064686] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e242bd06df207c45a09308e6","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e242bd06df207c45a09308e6: start","job_status":"start","queue_duration_s":1.398447,"scheduling_latency_s":1.398464}1667gitlab # [ 344.083408] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e242bd06df207c45a09308e6","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e242bd06df207c45a09308e6: done: 0.015739 sec","job_status":"done","queue_duration_s":1.398447,"scheduling_latency_s":1.398464,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015739,"completed_at":"2026-09-01T10:37:05.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 344.130803] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e73e264bf8b4b01cc0e673da","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e73e264bf8b4b01cc0e673da: start","job_status":"start","queue_duration_s":1.415599,"scheduling_latency_s":1.415617}1669gitlab # [ 344.145178] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e73e264bf8b4b01cc0e673da","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e73e264bf8b4b01cc0e673da: done: 0.015647 sec","job_status":"done","queue_duration_s":1.415599,"scheduling_latency_s":1.415617,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015647,"completed_at":"2026-09-01T10:37:05.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 344.185069] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54579ca59e0ca32b785ecf3c","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54579ca59e0ca32b785ecf3c: start","job_status":"start","queue_duration_s":1.433,"scheduling_latency_s":1.433018}1671gitlab # [ 344.197451] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54579ca59e0ca32b785ecf3c","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54579ca59e0ca32b785ecf3c: done: 0.016817 sec","job_status":"done","queue_duration_s":1.433,"scheduling_latency_s":1.433018,"redis_calls":13,"redis_duration_s":0.003979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002544,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016817,"completed_at":"2026-09-01T10:37:05.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 344.236221] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cb517fa466424bd0c491fec","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cb517fa466424bd0c491fec: start","job_status":"start","queue_duration_s":1.451303,"scheduling_latency_s":1.45132}1673gitlab # [ 344.248308] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cb517fa466424bd0c491fec","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cb517fa466424bd0c491fec: done: 0.015853 sec","job_status":"done","queue_duration_s":1.451303,"scheduling_latency_s":1.45132,"redis_calls":13,"redis_duration_s":0.003054,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015853,"completed_at":"2026-09-01T10:37:05.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 344.286756] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb002b0092952ad506ee8a0","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb002b0092952ad506ee8a0: start","job_status":"start","queue_duration_s":1.46863,"scheduling_latency_s":1.468648}1675gitlab # [ 344.298950] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb002b0092952ad506ee8a0","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb002b0092952ad506ee8a0: done: 0.015344 sec","job_status":"done","queue_duration_s":1.46863,"scheduling_latency_s":1.468648,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015344,"completed_at":"2026-09-01T10:37:05.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 344.338309] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bb53e8e6a18fac7c428677f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bb53e8e6a18fac7c428677f: start","job_status":"start","queue_duration_s":1.485408,"scheduling_latency_s":1.485426}1677gitlab # [ 344.350421] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bb53e8e6a18fac7c428677f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bb53e8e6a18fac7c428677f: done: 0.015437 sec","job_status":"done","queue_duration_s":1.485408,"scheduling_latency_s":1.485426,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015437,"completed_at":"2026-09-01T10:37:05.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 344.388932] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1623f6573e88540169c9d25c","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1623f6573e88540169c9d25c: start","job_status":"start","queue_duration_s":1.502401,"scheduling_latency_s":1.502419}1679gitlab # [ 344.400938] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1623f6573e88540169c9d25c","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1623f6573e88540169c9d25c: done: 0.015364 sec","job_status":"done","queue_duration_s":1.502401,"scheduling_latency_s":1.502419,"redis_calls":13,"redis_duration_s":0.002866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015364,"completed_at":"2026-09-01T10:37:05.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 344.439090] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67c58bd3481da221efed9ffd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67c58bd3481da221efed9ffd: start","job_status":"start","queue_duration_s":1.519203,"scheduling_latency_s":1.51922}1681gitlab # [ 344.451202] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67c58bd3481da221efed9ffd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67c58bd3481da221efed9ffd: done: 0.015167 sec","job_status":"done","queue_duration_s":1.519203,"scheduling_latency_s":1.51922,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015167,"completed_at":"2026-09-01T10:37:05.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 344.489354] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe54a1d92feb893d8dff6fa","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe54a1d92feb893d8dff6fa: start","job_status":"start","queue_duration_s":1.535696,"scheduling_latency_s":1.535728}1683gitlab # [ 344.501388] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe54a1d92feb893d8dff6fa","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe54a1d92feb893d8dff6fa: done: 0.015473 sec","job_status":"done","queue_duration_s":1.535696,"scheduling_latency_s":1.535728,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015473,"completed_at":"2026-09-01T10:37:05.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 344.540556] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72075d78a780d3fe7177fdbd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72075d78a780d3fe7177fdbd: start","job_status":"start","queue_duration_s":1.55434,"scheduling_latency_s":1.554387}1685gitlab # [ 344.552479] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72075d78a780d3fe7177fdbd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72075d78a780d3fe7177fdbd: done: 0.032155 sec","job_status":"done","queue_duration_s":1.55434,"scheduling_latency_s":1.554387,"redis_calls":13,"redis_duration_s":0.0035069999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032155,"completed_at":"2026-09-01T10:37:05.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 344.591427] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b3195f68197723bd517b33e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b3195f68197723bd517b33e: start","job_status":"start","queue_duration_s":1.587689,"scheduling_latency_s":1.587708}1687gitlab # [ 344.603886] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b3195f68197723bd517b33e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b3195f68197723bd517b33e: done: 0.017014 sec","job_status":"done","queue_duration_s":1.587689,"scheduling_latency_s":1.587708,"redis_calls":13,"redis_duration_s":0.0019420000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017014,"completed_at":"2026-09-01T10:37:05.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 344.643429] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a7dc93d70b965a1b4170a5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a7dc93d70b965a1b4170a5: start","job_status":"start","queue_duration_s":1.606084,"scheduling_latency_s":1.606107}1689gitlab # [ 344.655759] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a7dc93d70b965a1b4170a5","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a7dc93d70b965a1b4170a5: done: 0.021327 sec","job_status":"done","queue_duration_s":1.606084,"scheduling_latency_s":1.606107,"redis_calls":13,"redis_duration_s":0.003823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021327,"completed_at":"2026-09-01T10:37:05.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 344.694030] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcb1ef11f5b87ec736006879","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcb1ef11f5b87ec736006879: start","job_status":"start","queue_duration_s":1.629098,"scheduling_latency_s":1.629126}1691gitlab # [ 344.706268] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcb1ef11f5b87ec736006879","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcb1ef11f5b87ec736006879: done: 0.033879 sec","job_status":"done","queue_duration_s":1.629098,"scheduling_latency_s":1.629126,"redis_calls":13,"redis_duration_s":0.006274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033879,"completed_at":"2026-09-01T10:37:05.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 344.745460] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d131e02dfaea4b74337bcd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d131e02dfaea4b74337bcd: start","job_status":"start","queue_duration_s":1.66627,"scheduling_latency_s":1.666321}1693gitlab # [ 344.757626] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d131e02dfaea4b74337bcd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d131e02dfaea4b74337bcd: done: 0.034459 sec","job_status":"done","queue_duration_s":1.66627,"scheduling_latency_s":1.666321,"redis_calls":13,"redis_duration_s":0.004149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034459,"completed_at":"2026-09-01T10:37:05.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 344.795727] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8c307cbd9cca7455768b6a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8c307cbd9cca7455768b6a: start","job_status":"start","queue_duration_s":1.703065,"scheduling_latency_s":1.703103}1695gitlab # [ 344.808025] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8c307cbd9cca7455768b6a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8c307cbd9cca7455768b6a: done: 0.027652 sec","job_status":"done","queue_duration_s":1.703065,"scheduling_latency_s":1.703103,"redis_calls":13,"redis_duration_s":0.0034799999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027652,"completed_at":"2026-09-01T10:37:05.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 344.846901] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c42922dd2f4d98cadf8ce2fa","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c42922dd2f4d98cadf8ce2fa: start","job_status":"start","queue_duration_s":1.732893,"scheduling_latency_s":1.732929}1697gitlab # [ 344.883467] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c42922dd2f4d98cadf8ce2fa","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c42922dd2f4d98cadf8ce2fa: done: 0.023232 sec","job_status":"done","queue_duration_s":1.732893,"scheduling_latency_s":1.732929,"redis_calls":13,"redis_duration_s":0.003726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002616,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023232,"completed_at":"2026-09-01T10:37:05.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 344.957907] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5709252ec6bd139b67a0bb89","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5709252ec6bd139b67a0bb89: start","job_status":"start","queue_duration_s":1.75823,"scheduling_latency_s":1.758261}1699gitlab # [ 344.977128] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5709252ec6bd139b67a0bb89","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5709252ec6bd139b67a0bb89: done: 0.019703 sec","job_status":"done","queue_duration_s":1.75823,"scheduling_latency_s":1.758261,"redis_calls":13,"redis_duration_s":0.003156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019703,"completed_at":"2026-09-01T10:37:05.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 345.071216] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08aaa9cfc3af275823afd4a3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08aaa9cfc3af275823afd4a3: start","job_status":"start","queue_duration_s":1.779486,"scheduling_latency_s":1.779505}1701gitlab # [ 345.089396] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08aaa9cfc3af275823afd4a3","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08aaa9cfc3af275823afd4a3: done: 0.01699 sec","job_status":"done","queue_duration_s":1.779486,"scheduling_latency_s":1.779505,"redis_calls":13,"redis_duration_s":0.0029879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01699,"completed_at":"2026-09-01T10:37:05.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 345.132669] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73bae7eaee93e8b1f50b137a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73bae7eaee93e8b1f50b137a: start","job_status":"start","queue_duration_s":1.797931,"scheduling_latency_s":1.797948}1703gitlab # [ 345.145931] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73bae7eaee93e8b1f50b137a","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73bae7eaee93e8b1f50b137a: done: 0.016164 sec","job_status":"done","queue_duration_s":1.797931,"scheduling_latency_s":1.797948,"redis_calls":13,"redis_duration_s":0.003078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016164,"completed_at":"2026-09-01T10:37:05.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 345.184389] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa53c976b8001f78e5b98f47","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa53c976b8001f78e5b98f47: start","job_status":"start","queue_duration_s":1.823531,"scheduling_latency_s":1.82355}1705gitlab # [ 345.196411] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa53c976b8001f78e5b98f47","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa53c976b8001f78e5b98f47: done: 0.01656 sec","job_status":"done","queue_duration_s":1.823531,"scheduling_latency_s":1.82355,"redis_calls":13,"redis_duration_s":0.003233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01656,"completed_at":"2026-09-01T10:37:05.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 345.234516] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63a625a87dc2865d8de9585","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63a625a87dc2865d8de9585: start","job_status":"start","queue_duration_s":1.842096,"scheduling_latency_s":1.842113}1707gitlab # [ 345.246551] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63a625a87dc2865d8de9585","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63a625a87dc2865d8de9585: done: 0.015477 sec","job_status":"done","queue_duration_s":1.842096,"scheduling_latency_s":1.842113,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015477,"completed_at":"2026-09-01T10:37:05.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 345.284614] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b80366cfc78aab3617e05d6f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b80366cfc78aab3617e05d6f: start","job_status":"start","queue_duration_s":1.859017,"scheduling_latency_s":1.859033}1709gitlab # [ 345.296665] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b80366cfc78aab3617e05d6f","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b80366cfc78aab3617e05d6f: done: 0.015857 sec","job_status":"done","queue_duration_s":1.859017,"scheduling_latency_s":1.859033,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015857,"completed_at":"2026-09-01T10:37:05.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 345.335053] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d3d8842c07c9bdca9f40e2d","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d3d8842c07c9bdca9f40e2d: start","job_status":"start","queue_duration_s":1.876763,"scheduling_latency_s":1.87678}1711gitlab # [ 345.348393] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d3d8842c07c9bdca9f40e2d","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d3d8842c07c9bdca9f40e2d: done: 0.015625 sec","job_status":"done","queue_duration_s":1.876763,"scheduling_latency_s":1.87678,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015625,"completed_at":"2026-09-01T10:37:05.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 345.386018] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550078ec1a15bca34dbb5def","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550078ec1a15bca34dbb5def: start","job_status":"start","queue_duration_s":1.893821,"scheduling_latency_s":1.893838}1713gitlab # [ 345.398575] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550078ec1a15bca34dbb5def","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550078ec1a15bca34dbb5def: done: 0.015729 sec","job_status":"done","queue_duration_s":1.893821,"scheduling_latency_s":1.893838,"redis_calls":13,"redis_duration_s":0.002825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015729,"completed_at":"2026-09-01T10:37:05.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 345.437046] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8178f3b1341ae349ab128d0e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8178f3b1341ae349ab128d0e: start","job_status":"start","queue_duration_s":1.910955,"scheduling_latency_s":1.910971}1715gitlab # [ 345.449012] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8178f3b1341ae349ab128d0e","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8178f3b1341ae349ab128d0e: done: 0.015509 sec","job_status":"done","queue_duration_s":1.910955,"scheduling_latency_s":1.910971,"redis_calls":13,"redis_duration_s":0.0028520000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015509,"completed_at":"2026-09-01T10:37:05.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 345.487699] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef0fd181181d99b8928b746","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef0fd181181d99b8928b746: start","job_status":"start","queue_duration_s":1.927791,"scheduling_latency_s":1.927807}1717gitlab # [ 345.499729] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef0fd181181d99b8928b746","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef0fd181181d99b8928b746: done: 0.015443 sec","job_status":"done","queue_duration_s":1.927791,"scheduling_latency_s":1.927807,"redis_calls":13,"redis_duration_s":0.0024980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015443,"completed_at":"2026-09-01T10:37:05.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 345.538579] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd621167cc67c913aa793558","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd621167cc67c913aa793558: start","job_status":"start","queue_duration_s":1.945364,"scheduling_latency_s":1.945382}1719gitlab # [ 345.552057] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd621167cc67c913aa793558","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd621167cc67c913aa793558: done: 0.015586 sec","job_status":"done","queue_duration_s":1.945364,"scheduling_latency_s":1.945382,"redis_calls":13,"redis_duration_s":0.0027470000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015586,"completed_at":"2026-09-01T10:37:05.683Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 345.590023] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7ba896694919b178d446ec","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7ba896694919b178d446ec: start","job_status":"start","queue_duration_s":1.962315,"scheduling_latency_s":1.96233}1721gitlab # [ 345.602664] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7ba896694919b178d446ec","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7ba896694919b178d446ec: done: 0.015573 sec","job_status":"done","queue_duration_s":1.962315,"scheduling_latency_s":1.96233,"redis_calls":13,"redis_duration_s":0.0030380000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015573,"completed_at":"2026-09-01T10:37:05.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 345.641666] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95cc0d694968dda247f382dd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95cc0d694968dda247f382dd: start","job_status":"start","queue_duration_s":1.979302,"scheduling_latency_s":1.979318}1723gitlab # [ 345.654156] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95cc0d694968dda247f382dd","created_at":"2026-09-01T10:37:03.634Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-3c1f6aec951343f0","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d833e30307a61078fe8a5b3e0990cdd8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.722Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95cc0d694968dda247f382dd: done: 0.015124 sec","job_status":"done","queue_duration_s":1.979302,"scheduling_latency_s":1.979318,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015124,"completed_at":"2026-09-01T10:37:05.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 345.692933] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.718Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9801f13f7fcc8cbcb6c7a69","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9801f13f7fcc8cbcb6c7a69: start","job_status":"start","queue_duration_s":1.369898,"scheduling_latency_s":1.369916}1725gitlab # [ 345.705158] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.732Z","message":"No existing merge request to be cleaned up."}1726gitlab # [ 345.706798] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.742Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9801f13f7fcc8cbcb6c7a69","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9801f13f7fcc8cbcb6c7a69: done: 0.023381 sec","job_status":"done","queue_duration_s":1.369898,"scheduling_latency_s":1.369916,"redis_calls":11,"redis_duration_s":0.002896,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023381,"completed_at":"2026-09-01T10:37:05.741Z","load_balancing_strategy":"primary","db_duration_s":0.003209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 345.747633] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.743Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c9a8a97739fdf5b80295433","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c9a8a97739fdf5b80295433: start","job_status":"start","queue_duration_s":1.394695,"scheduling_latency_s":1.394711}1728gitlab # [ 345.760184] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.755Z","message":"No existing merge request to be cleaned up."}1729gitlab # [ 345.761838] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.764Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c9a8a97739fdf5b80295433","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c9a8a97739fdf5b80295433: done: 0.020868 sec","job_status":"done","queue_duration_s":1.394695,"scheduling_latency_s":1.394711,"redis_calls":10,"redis_duration_s":0.002654,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001556,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020868,"completed_at":"2026-09-01T10:37:05.764Z","load_balancing_strategy":"primary","db_duration_s":0.002744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 345.800216] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.766Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d84d3d08c92a557ec9332f0","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d84d3d08c92a557ec9332f0: start","job_status":"start","queue_duration_s":1.417584,"scheduling_latency_s":1.417602}1731gitlab # [ 345.812177] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.778Z","message":"No existing merge request to be cleaned up."}1732gitlab # [ 345.813829] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.787Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d84d3d08c92a557ec9332f0","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d84d3d08c92a557ec9332f0: done: 0.020987 sec","job_status":"done","queue_duration_s":1.417584,"scheduling_latency_s":1.417602,"redis_calls":10,"redis_duration_s":0.002862,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020987,"completed_at":"2026-09-01T10:37:05.787Z","load_balancing_strategy":"primary","db_duration_s":0.002689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 345.852171] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.789Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c6645638a7847036241040e","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c6645638a7847036241040e: start","job_status":"start","queue_duration_s":1.4404,"scheduling_latency_s":1.440417}1734gitlab # [ 345.864450] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.800Z","message":"No existing merge request to be cleaned up."}1735gitlab # [ 345.866115] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:05.809Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9c6645638a7847036241040e","created_at":"2026-09-01T10:37:04.333Z","trace_propagation_headers":{"sentry-trace":"e8c5fb2608b44c9b99c09198925283a6-0abecedd0f724527","baggage":"sentry-trace_id=e8c5fb2608b44c9b99c09198925283a6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c19cbea2d3f5d1cf9d101c792280cfcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:04.348Z","job_size_bytes":2,"pid":2044,"sidekiq_tid":"mao0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9c6645638a7847036241040e: done: 0.020409 sec","job_status":"done","queue_duration_s":1.4404,"scheduling_latency_s":1.440417,"redis_calls":10,"redis_duration_s":0.002634,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020409,"completed_at":"2026-09-01T10:37:05.809Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 346.844788] runuser[3093]: pam_unix(runuser:session): session closed for user gitlab1737gitlab # [ 346.846135] setup-gitlab-start[3051]: + systemctl restart gitlab-sidekiq.service1738gitlab # [ 346.889366] systemd[1]: Stopping gitlab-sidekiq.service...1739gitlab # [ 346.901079] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:17.674Z","message":"Shutting down"}1740gitlab # [ 346.903123] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:17.675Z","message":"Scheduler exiting..."}1741gitlab # [ 346.905245] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:17.676Z","message":"Terminating quiet threads for default capsule"}1742gitlab # [ 346.907629] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:17.676Z","message":"Scheduler exiting..."}1743gitlab # [ 347.404141] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:18.178Z","message":"Pausing to allow jobs to finish..."}1744gitlab # [ 350.409147] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:21.182Z","message":"Bye!"}1745gitlab # [ 350.450705] sidekiq-cluster[2044]: {"severity":"INFO","time":"2026-09-01T10:37:21.224Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2044,"worker_id":"sidekiq_0","memwd_rss_bytes":973508608,"retry":0}1746gitlab # [ 351.059769] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1747gitlab # [ 351.060439] systemd[1]: Stopped gitlab-sidekiq.service.1748gitlab # [ 351.065015] systemd[1]: gitlab-sidekiq.service: Consumed 2min 10.914s CPU time over 3min 45.551s wall clock time, 957.8M memory peak, 4.4M read from disk.1749gitlab # [ 351.070739] systemd[1]: Started gitlab-sidekiq.service.1750gitlab # [ 351.073687] setup-gitlab-start[3051]: + mkdir -p /var/lib/secrets1751gitlab # [ 351.079842] setup-gitlab-start[3051]: + echo nixbot-test-token-of-20-chars1752gitlab # [ 351.082790] setup-gitlab-start[3051]: + chmod 644 /var/lib/secrets/gitlab-token1753gitlab # [ 351.086318] setup-gitlab-start[3051]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1754gitlab # [ 352.505656] gitaly[894]: time="2026-09-01T10:37:23.278Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.277" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 352.535540] gitaly[894]: time="2026-09-01T10:37:23.279Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.277" grpc.time_ms=1.356 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 352.729959] gitaly[894]: time="2026-09-01T10:37:23.504Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.503" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 352.794351] gitaly[894]: time="2026-09-01T10:37:23.504Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.503" grpc.time_ms=0.607 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 352.823152] gitaly[894]: time="2026-09-01T10:37:23.569Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV diskcache=d3dad782-3e34-43f1-a077-108389908037 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:33.245" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.515" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 352.841837] gitaly[894]: time="2026-09-01T10:37:23.569Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=29 command.spawn_token_fork_ms=4 command.system_time_ms=20 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:33.245" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.515" grpc.time_ms=53.587 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 352.863682] gitaly[894]: time="2026-09-01T10:37:23.585Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.584" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1761gitlab # [ 352.880088] gitaly[894]: time="2026-09-01T10:37:23.585Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.584" grpc.time_ms=0.996 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 352.895458] gitaly[894]: time="2026-09-01T10:37:23.608Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:33.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.591" grpc.time_ms=16.804 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 352.919964] gitaly[894]: time="2026-09-01T10:37:23.694Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.113" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.694" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 352.952716] gitaly[894]: time="2026-09-01T10:37:23.694Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.113" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.694" grpc.time_ms=0.333 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 352.983279] gitaly[894]: time="2026-09-01T10:37:23.728Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV diskcache=4d828394-588f-4410-9ab4-419dc8ee2010 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:33.116" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.697" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 353.004266] gitaly[894]: time="2026-09-01T10:37:23.729Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:33.116" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.697" grpc.time_ms=31.705 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 353.029139] gitaly[894]: time="2026-09-01T10:37:23.735Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.154" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.734" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1768gitlab # [ 353.046740] gitaly[894]: time="2026-09-01T10:37:23.735Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.154" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.734" grpc.time_ms=0.843 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 353.063108] gitaly[894]: time="2026-09-01T10:37:23.746Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:33.159" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.739" grpc.time_ms=6.764 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 353.081734] gitaly[894]: time="2026-09-01T10:37:23.781Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:33.201" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.781" grpc.time_ms=0.32 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 353.095192] gitaly[894]: time="2026-09-01T10:37:23.790Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:37:33.209" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:23.790" grpc.time_ms=0.287 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 353.655581] gitaly[894]: time="2026-09-01T10:37:24.428Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q0K3QTCD2Z0D0019B8RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:34.141" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:24.411" grpc.time_ms=16.784 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 354.382917] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:25 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 32631774gitlab # [ 354.388111] setup-gitlab-start[3051]: + mkdir -p /tmp/test-flake1775gitlab # [ 354.392410] setup-gitlab-start[3051]: + cd /tmp/test-flake1776gitlab # [ 354.394818] setup-gitlab-start[3051]: + git init -b master1777gitlab # [ 354.435734] setup-gitlab-start[3581]: Initialized empty Git repository in /tmp/test-flake/.git/1778gitlab # [ 354.438891] setup-gitlab-start[3051]: + git config user.name test1779gitlab # [ 354.446521] setup-gitlab-start[3051]: + git config user.email test@example.com1780gitlab # [ 354.455014] setup-gitlab-start[3051]: + cat1781gitlab # [ 354.460854] setup-gitlab-start[3051]: + git add flake.nix1782gitlab # [ 354.469747] setup-gitlab-start[3051]: + git commit -m 'initial commit'1783gitlab # [ 354.504974] setup-gitlab-start[3590]: [master (root-commit) ed091d1] initial commit1784gitlab # [ 354.508819] setup-gitlab-start[3590]: 1 file changed, 10 insertions(+)1785gitlab # [ 354.511572] setup-gitlab-start[3590]: create mode 100644 flake.nix1786gitlab # [ 354.514340] setup-gitlab-start[3051]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1787gitlab # [ 354.519173] setup-gitlab-start[3051]: + git push -u origin master1788gitlab # [ 354.653795] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:25 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 821789gitlab # [ 355.488159] gitaly[894]: time="2026-09-01T10:37:26.262Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q41NTFR0WHBA70X4CCTX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:26.242" grpc.time_ms=19.408 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1790gitlab # [ 355.503472] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 8341791gitlab # [ 355.969230] gitaly[894]: time="2026-09-01T10:37:26.743Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:36.146" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:26.727" grpc.time_ms=15.784 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 356.059435] gitaly[894]: time="2026-09-01T10:37:26.833Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:37:56.013" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:37:26.814" grpc.time_ms=19.168 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 356.105311] gitaly[894]: time="2026-09-01T10:37:26.879Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8Q4WEN00PV46AP0G33TTF duration_ms=293ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1794gitlab # [ 356.128363] sidekiq-cluster[3528]: {"severity":"INFO","time":"2026-09-01T10:37:26.873Z","message":"Starting cluster with 1 processes"}1795gitlab # [ 356.364612] gitaly[894]: time="2026-09-01T10:37:27.139Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8Q4WEN00PV46AP0G33TTF duration_ms=258ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1796gitlab # [ 356.367552] gitaly[894]: time="2026-09-01T10:37:27.140Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:26.584" grpc.time_ms=555.427 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1797gitlab # [ 356.425931] gitaly[894]: time="2026-09-01T10:37:27.200Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:27.199" grpc.time_ms=0.841 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1798gitlab # [ 356.510365] gitaly[894]: time="2026-09-01T10:37:27.283Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:27.282" grpc.time_ms=1.16 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1799gitlab # [ 356.551469] gitaly[894]: time="2026-09-01T10:37:27.325Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:27.324" grpc.time_ms=0.869 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1800gitlab # [ 357.097943] gitaly[894]: time="2026-09-01T10:37:27.872Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:37.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:27.854" grpc.time_ms=17.714 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 357.159542] gitaly[894]: time="2026-09-01T10:37:27.933Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:37:37.043" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:27.894" grpc.time_ms=39.126 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 357.244365] gitaly[894]: time="2026-09-01T10:37:28.018Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8Q4WEN00PV46AP0G33TTF duration_ms=640ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1803gitlab # [ 357.247351] gitaly[894]: time="2026-09-01T10:37:28.020Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:27.377" grpc.time_ms=642.549 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1804gitlab # [ 357.260457] gitaly[894]: time="2026-09-01T10:37:28.034Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF diskcache=bc5b3bc8-d9a6-48d5-a3fc-9b7ed5044c3b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:26.461" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1805gitlab # [ 357.270495] gitaly[894]: time="2026-09-01T10:37:28.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=325 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13469 command.oublock=32 command.real_time_ms=1562 command.spawn_token_fork_ms=2 command.system_time_ms=185 command.user_time_ms=140 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:26.461" grpc.time_ms=1573.283 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1806gitlab # [ 357.284162] setup-gitlab-start[3594]: To http://gitlab/root/test-flake.git1807gitlab # [ 357.285081] setup-gitlab-start[3594]: * [new branch] master -> master1808gitlab # [ 357.285994] setup-gitlab-start[3594]: branch 'master' set up to track 'origin/master'.1809gitlab # [ 357.287429] gitlab-workhorse[821]: time="2026-09-01T10:37:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521810gitlab # [ 357.289350] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 17491811gitlab # [ 357.291466] systemd[1]: Finished setup-gitlab.service.1812gitlab # [ 357.292281] systemd[1]: Starting nixbot CI service...1813gitlab: (finished: waiting for unit setup-gitlab.service, in 358.29 seconds)1814gitlab: waiting for unit nixbot.service1815gitlab # [ 358.743038] nixbot[3690]: {"ts": "2026-09-01T10:37:29.516Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1816gitlab # [ 358.783438] nixbot[3690]: {"ts": "2026-09-01T10:37:29.557Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1817gitlab # [ 358.825129] nixbot[3690]: {"ts": "2026-09-01T10:37:29.599Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1818gitlab # [ 358.831736] nixbot[3690]: {"ts": "2026-09-01T10:37:29.605Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1819gitlab # [ 358.839797] nixbot[3690]: {"ts": "2026-09-01T10:37:29.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1820gitlab # [ 358.849589] nixbot[3690]: {"ts": "2026-09-01T10:37:29.623Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1821gitlab # [ 358.860358] nixbot[3690]: {"ts": "2026-09-01T10:37:29.634Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1822gitlab # [ 358.865859] nixbot[3690]: {"ts": "2026-09-01T10:37:29.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1823gitlab # [ 358.875728] nixbot[3690]: {"ts": "2026-09-01T10:37:29.650Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1824gitlab # [ 358.880963] nixbot[3690]: {"ts": "2026-09-01T10:37:29.652Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1825gitlab # [ 358.886977] nixbot[3690]: {"ts": "2026-09-01T10:37:29.661Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1826gitlab # [ 358.897509] nixbot[3690]: {"ts": "2026-09-01T10:37:29.671Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1827gitlab # [ 358.902993] nixbot[3690]: {"ts": "2026-09-01T10:37:29.676Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1828gitlab # [ 358.908671] nixbot[3690]: {"ts": "2026-09-01T10:37:29.678Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1829gitlab # [ 358.914066] nixbot[3690]: {"ts": "2026-09-01T10:37:29.685Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1830gitlab # [ 358.919432] nixbot[3690]: {"ts": "2026-09-01T10:37:29.689Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1831gitlab # [ 358.924421] nixbot[3690]: {"ts": "2026-09-01T10:37:29.692Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1832gitlab # [ 358.929269] nixbot[3690]: {"ts": "2026-09-01T10:37:29.694Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1833gitlab # [ 358.933849] nixbot[3690]: {"ts": "2026-09-01T10:37:29.703Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1834gitlab # [ 358.938306] nixbot[3690]: {"ts": "2026-09-01T10:37:29.706Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1835gitlab # [ 358.942748] nixbot[3690]: {"ts": "2026-09-01T10:37:29.708Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1836gitlab # [ 358.947105] nixbot[3690]: {"ts": "2026-09-01T10:37:29.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1837gitlab # [ 358.951723] nixbot[3690]: {"ts": "2026-09-01T10:37:29.720Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1838gitlab # [ 358.956238] nixbot[3690]: {"ts": "2026-09-01T10:37:29.723Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1839gitlab # [ 358.960348] nixbot[3690]: {"ts": "2026-09-01T10:37:29.725Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1840gitlab # [ 358.964439] nixbot[3690]: {"ts": "2026-09-01T10:37:29.729Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1841gitlab # [ 358.968394] nixbot[3690]: {"ts": "2026-09-01T10:37:29.732Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1842gitlab # [ 358.972054] nixbot[3690]: {"ts": "2026-09-01T10:37:29.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1843gitlab # [ 359.381716] nixbot[3690]: INFO: Started server process [3690]1844gitlab # [ 359.384470] nixbot[3690]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1845gitlab # [ 359.408181] nixbot[3690]: INFO: ::ffff:127.0.0.1:45804 - "GET /health HTTP/1.1" 200 OK1846gitlab # [ 359.415584] systemd[1]: Started nixbot CI service.1847gitlab # [ 359.416880] systemd[1]: Reached target Multi-User System.1848gitlab # [ 359.420410] systemd[1]: Startup finished in 840ms (kernel) + 4.288s (initrd) + 5min 54.291s (userspace) = 5min 59.420s.1849gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1850gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1851gitlab # [ 359.994204] nixbot[3690]: INFO: ::ffff:127.0.0.1:45812 - "GET /health HTTP/1.1" 200 OK1852gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1853subtest: project discovered and webhook registered1854gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1855gitlab # [ 360.170863] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1151856gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1857gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1858gitlab # [ 361.364860] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1221859gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1860gitlab # [ 362.029541] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:32 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 26251861gitlab # [ 362.031972] nixbot[3690]: {"ts": "2026-09-01T10:37:32.805Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1862gitlab # [ 362.055736] nixbot[3690]: {"ts": "2026-09-01T10:37:32.829Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1863gitlab # [ 362.176329] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1091864gitlab # [ 362.182683] nixbot[3690]: {"ts": "2026-09-01T10:37:32.952Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1865gitlab # [ 362.189604] nixbot[3690]: {"ts": "2026-09-01T10:37:32.955Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1866gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1867gitlab # [ 362.426187] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2401868gitlab # [ 362.433291] nixbot[3690]: {"ts": "2026-09-01T10:37:33.200Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1869gitlab # [ 362.556150] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1601870gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1871(finished: subtest: project discovered and webhook registered, in 2.56 seconds)1872subtest: push delivers the webhook1873gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1874gitlab # [ 362.583155] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1481875gitlab # [ 362.595821] nixbot[3690]: {"ts": "2026-09-01T10:37:33.358Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1876gitlab # [ 362.659989] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 681877gitlab # [ 362.666612] nixbot[3690]: {"ts": "2026-09-01T10:37:33.435Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1878gitlab # [ 362.673604] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 401879gitlab # [ 362.734858] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 691880gitlab # [ 362.741366] nixbot[3690]: {"ts": "2026-09-01T10:37:33.511Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1881gitlab # [ 362.760931] gitaly[894]: time="2026-09-01T10:37:33.535Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QBWBMW7KQHVAQRXNXZNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:33.525" grpc.time_ms=9.769 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882gitlab # [ 362.774202] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 861883gitlab # Enumerating objects: 5, done.1884gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1885gitlab # Delta compression using up to 4 threads1886gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1887gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 68.00 KiB/s, done.1888gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1889gitlab # [ 362.822669] gitaly[894]: time="2026-09-01T10:37:33.596Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QBYE5Q6QKYYNMM1RXF8R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-01T10:38:03.077" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:33.578" grpc.time_ms=17.218 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 362.866045] gitaly[894]: time="2026-09-01T10:37:33.640Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QBYE5Q6QKYYNMM1RXF8R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:03.137" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:33.638" grpc.time_ms=1.329 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 362.892586] gitaly[894]: time="2026-09-01T10:37:33.667Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QBYE5Q6QKYYNMM1RXF8R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-01T10:37:43.078" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:33.659" grpc.time_ms=7.891 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892gitlab # [ 362.929457] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1841893gitlab # [ 362.931800] nixbot[3690]: {"ts": "2026-09-01T10:37:33.706Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1894gitlab # [ 363.046636] nixbot[3690]: {"ts": "2026-09-01T10:37:33.819Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1895gitlab # [ 363.051828] gitaly[894]: time="2026-09-01T10:37:33.820Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:38:03.005" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:37:33.805" grpc.time_ms=14.329 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 363.068423] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1001897gitlab # [ 363.070848] nixbot[3690]: {"ts": "2026-09-01T10:37:33.825Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1898gitlab # [ 363.073558] gitaly[894]: time="2026-09-01T10:37:33.835Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW duration_ms=98ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1899gitlab # [ 363.104342] gitaly[894]: time="2026-09-01T10:37:33.878Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW duration_ms=42ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1900gitlab # [ 363.107999] gitaly[894]: time="2026-09-01T10:37:33.882Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:33.735" grpc.time_ms=144.74 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1901gitlab # [ 363.160117] gitaly[894]: time="2026-09-01T10:37:33.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:33.933" grpc.time_ms=0.872 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1902gitlab # [ 363.199738] gitaly[894]: time="2026-09-01T10:37:33.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:33.973" grpc.time_ms=0.605 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1903gitlab # [ 363.212043] gitaly[894]: time="2026-09-01T10:37:33.975Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QCAK7AFXT3MP1JZXCGWA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:33.965" grpc.time_ms=9.334 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1904gitlab # [ 363.225846] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 701905gitlab # [ 363.241473] gitaly[894]: time="2026-09-01T10:37:34.016Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:34.015" grpc.time_ms=0.562 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1906gitlab # [ 363.323833] gitaly[894]: time="2026-09-01T10:37:34.098Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW duration_ms=48ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1907gitlab # [ 363.332285] gitaly[894]: time="2026-09-01T10:37:34.098Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:34.048" grpc.time_ms=50.03 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1908gitlab # [ 363.344682] gitaly[894]: time="2026-09-01T10:37:34.119Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW diskcache=fbbe2a9f-46e0-4ecf-b041-0e82eaf36a02 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:33.659" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1909gitlab # To http://gitlab/root/test-flake.git1910gitlab # [ 363.361361] gitaly[894]: time="2026-09-01T10:37:34.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=200 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=13629 command.oublock=32 command.real_time_ms=441 command.spawn_token_fork_ms=2 command.system_time_ms=109 command.user_time_ms=91 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:33.659" grpc.time_ms=459.421 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1911gitlab # ed091d1..25be946 [ 363.380811] gitlab-workhorse[821]: time="2026-09-01T10:37:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521912gitlab # master -> master[ 363.383295] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5381913gitlab # 1914gitlab # [ 363.385799] gitlab-workhorse[821]: time="2026-09-01T10:37:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131915gitlab # [ 363.388082] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1481916gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.84 seconds)1917gitlab # [ 363.390365] gitaly[894]: time="2026-09-01T10:37:34.126Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCCVKZ8R8E8C0GWN6ZBE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.103" pid=894 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1918gitlab: must succeed: git -C /tmp/test-flake rev-parse master1919gitlab # [ 363.402166] gitaly[894]: time="2026-09-01T10:37:34.126Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCCVKZ8R8E8C0GWN6ZBE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.103" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1922gitlab # [ 363.417839] gitaly[894]: time="2026-09-01T10:37:34.127Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCCVKZ8R8E8C0GWN6ZBE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.103" grpc.time_ms=23.862 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab # [ 363.445982] gitaly[894]: time="2026-09-01T10:37:34.220Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCHK8RTM261AT8XMFNCT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.200" pid=894 remote_ip="2001:db8:1::1" request_sha=f621f087f1e86db481c08b5e243b8e8154438aa7 response_bytes=418 span.kind=server system=grpc1924gitlab # [ 363.458086] gitaly[894]: time="2026-09-01T10:37:34.220Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCHK8RTM261AT8XMFNCT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.200" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 363.473842] gitlab-workhorse[821]: time="2026-09-01T10:37:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181926gitlab # [ 363.475793] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 911927gitlab # [ 363.478008] gitaly[894]: time="2026-09-01T10:37:34.220Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCHK8RTM261AT8XMFNCT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.200" grpc.time_ms=19.75 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 363.505939] nixbot[3690]: INFO: ::ffff:127.0.0.1:48436 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.09 seconds)1930gitlab # [ 363.588289] gitaly[894]: time="2026-09-01T10:37:34.362Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QCPQS0WQF9EKRMD3D2C7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.348" grpc.time_ms=13.948 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931gitlab # [ 363.620296] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 671932gitlab # [ 363.674221] gitaly[894]: time="2026-09-01T10:37:34.448Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCRWZVQWX9DJBADNS5DH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.425" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1933gitlab # [ 363.702225] gitaly[894]: time="2026-09-01T10:37:34.448Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCRWZVQWX9DJBADNS5DH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.425" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1934gitlab # [ 363.727929] gitlab-workhorse[821]: time="2026-09-01T10:37:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671935gitlab # [ 363.731111] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841936gitlab # [ 363.734245] gitaly[894]: time="2026-09-01T10:37:34.448Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QCRWZVQWX9DJBADNS5DH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.425" grpc.time_ms=23.799 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 363.836246] gitaly[894]: time="2026-09-01T10:37:34.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QCXP44Z9WYNFVDZZG45Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.590" grpc.time_ms=17.902 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1938gitlab # [ 363.872207] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 901939gitlab # [ 363.952407] gitaly[894]: time="2026-09-01T10:37:34.726Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD0MRYC7WDGQ0PPAH560 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.692" pid=894 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1940gitlab # [ 363.983320] gitaly[894]: time="2026-09-01T10:37:34.727Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD0MRYC7WDGQ0PPAH560 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.692" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1941gitlab # [ 364.023046] gitlab-workhorse[821]: time="2026-09-01T10:37:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091942gitlab # [ 364.027240] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1151943gitlab # [ 364.031204] gitaly[894]: time="2026-09-01T10:37:34.727Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD0MRYC7WDGQ0PPAH560 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:34.692" grpc.time_ms=34.814 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1944gitlab # [ 364.146539] gitaly[894]: time="2026-09-01T10:37:34.920Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:04.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:34.919" grpc.time_ms=1.114 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 364.240885] gitaly[894]: time="2026-09-01T10:37:35.015Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:38:04.096" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:34.996" grpc.time_ms=18.098 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 364.287200] gitaly[894]: time="2026-09-01T10:37:35.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:37:45.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:35.044" grpc.time_ms=16.442 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 364.322420] gitaly[894]: time="2026-09-01T10:37:35.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:37:45.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:35.080" grpc.time_ms=16.296 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 364.473731] gitaly[894]: time="2026-09-01T10:37:35.248Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:37:45.206" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:35.247" grpc.time_ms=0.552 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1950gitlab # [ 364.544365] gitaly[894]: time="2026-09-01T10:37:35.318Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=8 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:37:45.256" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:35.297" grpc.time_ms=21.01 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.07 seconds)1952gitlab # [ 364.582782] nixbot[3690]: INFO: ::ffff:127.0.0.1:48450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1953gitlab # [ 364.630574] gitaly[894]: time="2026-09-01T10:37:35.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:35.403" grpc.time_ms=0.979 pid=894 span.kind=server system=grpc1954gitlab # [ 364.681457] gitaly[894]: time="2026-09-01T10:37:35.455Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:35.454" grpc.time_ms=0.816 pid=894 span.kind=server system=grpc1955gitlab # [ 364.711011] gitaly[894]: time="2026-09-01T10:37:35.469Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 diskcache=4fb44e8d-c16a-498b-a6e0-3374ac2d5a2e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:37:45.283" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:35.324" pid=894 ref=refs/keep-around/ed091d128df860d894fe1980a038608c243b6fec remote_ip="2001:db8:1::1" revision=ed091d128df860d894fe1980a038608c243b6fec span.kind=server system=grpc username=root1956gitlab # [ 364.734004] gitaly[894]: time="2026-09-01T10:37:35.469Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5449 command.oublock=8 command.real_time_ms=135 command.spawn_token_fork_ms=6 command.system_time_ms=69 command.user_time_ms=67 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:37:45.283" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:35.324" grpc.time_ms=145.263 pid=894 ref=refs/keep-around/ed091d128df860d894fe1980a038608c243b6fec remote_ip="2001:db8:1::1" revision=ed091d128df860d894fe1980a038608c243b6fec span.kind=server system=grpc username=root1957gitlab # [ 364.757361] gitaly[894]: time="2026-09-01T10:37:35.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:05.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:35.477" grpc.time_ms=0.786 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 365.170591] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 11231959gitlab # [ 365.179424] nixbot[3690]: {"ts": "2026-09-01T10:37:35.943Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}1960gitlab # [ 365.193801] nixbot[3690]: {"ts": "2026-09-01T10:37:35.967Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-ed091d128df8-0"}1961gitlab # [ 365.511088] nixbot[3690]: {"ts": "2026-09-01T10:37:36.285Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-ed091d128df8-0", "argv0": "bwrap"}1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1964gitlab # [ 365.645149] nixbot[3690]: INFO: ::ffff:127.0.0.1:48456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1965gitlab # [ 365.696719] systemd[1]: Started Nix Daemon.1966gitlab # [ 365.811979] nix-daemon[3927]: accepted connection from pid 3919, user nixbot1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1968gitlab # [ 366.700286] nixbot[3690]: INFO: ::ffff:127.0.0.1:48466 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)1972gitlab # [ 367.755930] nixbot[3690]: INFO: ::ffff:127.0.0.1:48476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1974gitlab # [ 368.810580] nixbot[3690]: INFO: ::ffff:127.0.0.1:48478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1977gitlab # [ 369.864998] nixbot[3690]: INFO: ::ffff:127.0.0.1:48490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1979gitlab # [ 369.952117] nix-daemon[3927]: accepted connection from pid 3950, user nixbot1980gitlab # [ 369.976647] nix-daemon[3927]: accepted connection from pid 3919, user nixbot1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)1983gitlab # [ 370.927444] nixbot[3690]: INFO: ::ffff:127.0.0.1:55020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1985gitlab # [ 371.981521] nixbot[3690]: INFO: ::ffff:127.0.0.1:55034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1988gitlab # [ 373.037966] nixbot[3690]: INFO: ::ffff:127.0.0.1:55044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1990gitlab # [ 373.881026] nix-daemon[3927]: accepted connection from pid 3919, user nixbot1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'1992gitlab # [ 374.096899] nixbot[3690]: INFO: ::ffff:127.0.0.1:55054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)1994gitlab # [ 374.105949] gitaly[894]: time="2026-09-01T10:37:44.872Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QPXC3W9Z6QDBX2A25D10 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:14.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:44.871" grpc.time_ms=1.033 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 374.382560] gitaly[894]: time="2026-09-01T10:37:45.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QPXC3W9Z6QDBX2A25D10 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:37:55.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:45.138" grpc.time_ms=18.604 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 374.563949] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 5871997gitlab # [ 374.572085] nixbot[3690]: {"ts": "2026-09-01T10:37:45.339Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}1998gitlab # [ 374.863913] gitaly[894]: time="2026-09-01T10:37:45.638Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQG4W4MK8APXT6J44XV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:15.236" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:45.637" grpc.time_ms=0.993 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 374.918837] gitaly[894]: time="2026-09-01T10:37:45.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QQG4W4MK8APXT6J44XV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:37:55.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:45.675" grpc.time_ms=17.187 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 375.001274] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4262001gitlab # [ 375.007412] nixbot[3690]: {"ts": "2026-09-01T10:37:45.777Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2003gitlab # [ 375.120860] gitaly[894]: time="2026-09-01T10:37:45.894Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQY6GFRJZXBW345BMYXG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:15.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:45.893" grpc.time_ms=0.846 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 375.157933] nixbot[3690]: INFO: ::ffff:127.0.0.1:55066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2006gitlab # [ 375.174482] gitaly[894]: time="2026-09-01T10:37:45.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QQY6GFRJZXBW345BMYXG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:37:55.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:45.929" grpc.time_ms=18.841 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 375.289862] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2652008gitlab # [ 375.299060] nixbot[3690]: {"ts": "2026-09-01T10:37:46.066Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}2009gitlab # [ 375.604653] gitaly[894]: time="2026-09-01T10:37:46.379Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QRDEXHB56XX979TXPV0G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:46.361" grpc.time_ms=16.958 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2010gitlab # [ 375.623091] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 932011gitlab # [ 375.766946] gitaly[894]: time="2026-09-01T10:37:46.541Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QRGE0BZWYJCWZ9WRAW70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:46.523" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2012gitlab # [ 375.786007] gitaly[894]: time="2026-09-01T10:37:46.541Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QRGE0BZWYJCWZ9WRAW70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:46.523" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2013gitlab # [ 375.806502] gitlab-workhorse[821]: time="2026-09-01T10:37:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672014gitlab # [ 375.809229] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1602015gitlab # [ 375.812156] gitaly[894]: time="2026-09-01T10:37:46.542Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QRGE0BZWYJCWZ9WRAW70 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:46.523" grpc.time_ms=18.887 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2017gitlab # [ 376.221097] nixbot[3690]: INFO: ::ffff:127.0.0.1:55082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2020gitlab # [ 377.277837] nixbot[3690]: INFO: ::ffff:127.0.0.1:55094 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2024gitlab # [ 378.335202] nixbot[3690]: INFO: ::ffff:127.0.0.1:55108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2027gitlab # [ 379.389937] nixbot[3690]: INFO: ::ffff:127.0.0.1:55114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2029gitlab # [ 380.444245] nixbot[3690]: INFO: ::ffff:127.0.0.1:55120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2033gitlab # [ 381.501853] nixbot[3690]: INFO: ::ffff:127.0.0.1:42004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2035gitlab # [ 382.555505] nixbot[3690]: INFO: ::ffff:127.0.0.1:42016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2038gitlab # [ 383.611848] nixbot[3690]: INFO: ::ffff:127.0.0.1:42020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2042gitlab # [ 384.668659] nixbot[3690]: INFO: ::ffff:127.0.0.1:42024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2044gitlab # [ 385.724088] nixbot[3690]: INFO: ::ffff:127.0.0.1:42032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2047gitlab # [ 386.780244] nixbot[3690]: INFO: ::ffff:127.0.0.1:42044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2050gitlab # [ 387.836453] nixbot[3690]: INFO: ::ffff:127.0.0.1:42060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2054gitlab # [ 388.891897] nixbot[3690]: INFO: ::ffff:127.0.0.1:42066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2057gitlab # [ 389.946819] nixbot[3690]: INFO: ::ffff:127.0.0.1:42082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2059gitlab # [ 390.999714] nixbot[3690]: INFO: ::ffff:127.0.0.1:54158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2062gitlab # [ 392.055512] nixbot[3690]: INFO: ::ffff:127.0.0.1:54168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2065gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2066gitlab # [ 393.111487] nixbot[3690]: INFO: ::ffff:127.0.0.1:54178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2067gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2069gitlab # [ 394.166038] nixbot[3690]: INFO: ::ffff:127.0.0.1:54188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2070gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2071gitlab # [ 395.220138] nixbot[3690]: INFO: ::ffff:127.0.0.1:54200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2072gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2074gitlab # [ 396.278331] nixbot[3690]: INFO: ::ffff:127.0.0.1:54212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2076gitlab # [ 396.944270] sidekiq-cluster[3631]: 2026-09-01T10:38:07.717Z pid=3631 tid=y2v INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3631, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431259648}2077gitlab # [ 397.250519] sidekiq-cluster[3631]: W, [2026-09-01T10:38:08.024737 #3631] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2079gitlab # [ 397.317467] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:08.091Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2080gitlab # [ 397.335163] nixbot[3690]: INFO: ::ffff:127.0.0.1:54226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2081gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2083gitlab # [ 398.392358] nixbot[3690]: INFO: ::ffff:127.0.0.1:54242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2086gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2087gitlab # [ 399.450701] nixbot[3690]: INFO: ::ffff:127.0.0.1:54246 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2089gitlab # [ 400.508427] nixbot[3690]: INFO: ::ffff:127.0.0.1:54248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2091gitlab # [ 400.961647] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:11.734Z","message":"GitLab reliable fetch activated!"}2092gitlab # [ 400.966643] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:11.735Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2093gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2095gitlab # [ 401.566003] nixbot[3690]: INFO: ::ffff:127.0.0.1:57786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2097gitlab # [ 402.621836] nixbot[3690]: INFO: ::ffff:127.0.0.1:57798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2099gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2100gitlab # [ 403.679217] nixbot[3690]: INFO: ::ffff:127.0.0.1:57810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2101gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2103gitlab # [ 404.735875] nixbot[3690]: INFO: ::ffff:127.0.0.1:57824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2105gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2106gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2107gitlab # [ 405.791856] nixbot[3690]: INFO: ::ffff:127.0.0.1:57840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2108gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2109gitlab # [ 406.847715] nixbot[3690]: INFO: ::ffff:127.0.0.1:57846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2110gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2111gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2112gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2113gitlab # [ 407.904728] nixbot[3690]: INFO: ::ffff:127.0.0.1:57860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2114gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2115gitlab # [ 408.957722] nixbot[3690]: INFO: ::ffff:127.0.0.1:57866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2116gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2117gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2118gitlab # [ 410.014475] nixbot[3690]: INFO: ::ffff:127.0.0.1:57878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2119gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2120gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2121gitlab # [ 411.071647] nixbot[3690]: INFO: ::ffff:127.0.0.1:59054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2122gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2124gitlab # [ 412.128806] nixbot[3690]: INFO: ::ffff:127.0.0.1:59068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2125gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2126gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2127gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2128gitlab # [ 413.185104] nixbot[3690]: INFO: ::ffff:127.0.0.1:59080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2130gitlab # [ 414.239957] nixbot[3690]: INFO: ::ffff:127.0.0.1:59090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2131gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2132gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2133gitlab # [ 415.296259] nixbot[3690]: INFO: ::ffff:127.0.0.1:59100 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2134gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2137gitlab # [ 416.352203] nixbot[3690]: INFO: ::ffff:127.0.0.1:59104 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2138gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2139gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2140gitlab # [ 417.406185] nixbot[3690]: INFO: ::ffff:127.0.0.1:59112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2142gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2143gitlab # [ 418.459671] nixbot[3690]: INFO: ::ffff:127.0.0.1:59128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2145gitlab # [ 419.514180] nixbot[3690]: INFO: ::ffff:127.0.0.1:59144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2146gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2148gitlab # [ 420.570599] nixbot[3690]: INFO: ::ffff:127.0.0.1:59146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2149gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2150gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2151gitlab # [ 421.627078] nixbot[3690]: INFO: ::ffff:127.0.0.1:42554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2153gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2154gitlab # [ 422.683192] nixbot[3690]: INFO: ::ffff:127.0.0.1:42566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2156gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2157gitlab # [ 423.740192] nixbot[3690]: INFO: ::ffff:127.0.0.1:42578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2158gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2159gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2160gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2161gitlab # [ 424.797353] nixbot[3690]: INFO: ::ffff:127.0.0.1:42592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2162gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2163gitlab # [ 425.852240] nixbot[3690]: INFO: ::ffff:127.0.0.1:42596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2164gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2166gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2167gitlab # [ 426.909997] nixbot[3690]: INFO: ::ffff:127.0.0.1:42602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2168gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2169gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2170gitlab # [ 427.963409] nixbot[3690]: INFO: ::ffff:127.0.0.1:42606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2171gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2172gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2173gitlab # [ 429.016921] nixbot[3690]: INFO: ::ffff:127.0.0.1:42618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2174gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2175gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2176gitlab # [ 430.071830] nixbot[3690]: INFO: ::ffff:127.0.0.1:42626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2177gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2178gitlab # [ 431.126725] nixbot[3690]: INFO: ::ffff:127.0.0.1:43510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2179gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2180gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2181gitlab # [ 432.184149] nixbot[3690]: INFO: ::ffff:127.0.0.1:43514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2182gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2183gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2184gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2185gitlab # [ 433.241468] nixbot[3690]: INFO: ::ffff:127.0.0.1:43528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2186gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2187gitlab # [ 434.294673] nixbot[3690]: INFO: ::ffff:127.0.0.1:43544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2188gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2189gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2190gitlab # [ 435.354851] nixbot[3690]: INFO: ::ffff:127.0.0.1:43560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2191gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2192gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2193gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2194gitlab # [ 436.410718] nixbot[3690]: INFO: ::ffff:127.0.0.1:43572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2195gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2196gitlab # [ 437.466240] nixbot[3690]: INFO: ::ffff:127.0.0.1:43586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2197gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2199gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2200gitlab # [ 438.523142] nixbot[3690]: INFO: ::ffff:127.0.0.1:43598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2201gitlab # [ 438.882899] postgres[4217]: [4217] ERROR: relation "table_without_models" does not exist2202gitlab # [ 438.886465] postgres[4217]: [4217] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2203gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2204gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2205gitlab # [ 439.577487] nixbot[3690]: INFO: ::ffff:127.0.0.1:43600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2206gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2207gitlab # [ 440.632345] nixbot[3690]: INFO: ::ffff:127.0.0.1:43616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2208gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2209gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2210gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2211gitlab # [ 441.688410] nixbot[3690]: INFO: ::ffff:127.0.0.1:45268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2212gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2213gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2214gitlab # [ 442.742525] nixbot[3690]: INFO: ::ffff:127.0.0.1:45284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2215gitlab # [ 443.719790] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:54.493Z","message":"Booted Rails 7.2.3.1 application in production environment"}2216gitlab # [ 443.722421] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:54.496Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2217gitlab # [ 443.728787] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:54.496Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2218gitlab # [ 443.734121] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:54.496Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2219gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2220gitlab # [ 443.741264] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:54.498Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2221gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2222gitlab # [ 443.797813] nixbot[3690]: INFO: ::ffff:127.0.0.1:45296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2223gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2224gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2225gitlab # [ 444.851004] nixbot[3690]: INFO: ::ffff:127.0.0.1:45298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2226gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2227gitlab # [ 445.905696] nixbot[3690]: INFO: ::ffff:127.0.0.1:45302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2228gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2229gitlab # [ 446.340407] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.112Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"08d5285971409d9a8bbc29e6","created_at":"2026-09-01T10:37:23.622Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:23.665Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-08d5285971409d9a8bbc29e6: start","job_status":"start","queue_duration_s":93.44687,"scheduling_latency_s":93.44697}2230gitlab # [ 446.732465] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.505Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"08d5285971409d9a8bbc29e6","created_at":"2026-09-01T10:37:23.622Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:23.665Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-08d5285971409d9a8bbc29e6: done: 0.393021 sec","job_status":"done","queue_duration_s":93.44687,"scheduling_latency_s":93.44697,"redis_calls":23,"redis_duration_s":0.011793999999999999,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006261,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003358,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2020274,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.393021,"completed_at":"2026-09-01T10:38:57.505Z","load_balancing_strategy":"primary","db_duration_s":0.108567,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2231gitlab # [ 446.831973] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.508Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"48b2aef60b5ed68958bf639f","created_at":"2026-09-01T10:37:23.681Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:23.688Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-48b2aef60b5ed68958bf639f: start","job_status":"start","queue_duration_s":93.820264,"scheduling_latency_s":93.820302}2232gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2233gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.07 seconds)2234gitlab # [ 446.922463] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.696Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"48b2aef60b5ed68958bf639f","created_at":"2026-09-01T10:37:23.681Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:23.688Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-48b2aef60b5ed68958bf639f: done: 0.187186 sec","job_status":"done","queue_duration_s":93.820264,"scheduling_latency_s":93.820302,"redis_calls":14,"redis_duration_s":0.005394,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001046,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002579,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14181613999999998,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.187186,"completed_at":"2026-09-01T10:38:57.695Z","load_balancing_strategy":"primary","db_duration_s":0.036806,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2235gitlab # [ 447.035482] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.698Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1b2669e617f55552ee4aa11a","created_at":"2026-09-01T10:37:24.266Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.274Z","job_size_bytes":5,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1b2669e617f55552ee4aa11a: start","job_status":"start","queue_duration_s":93.424097,"scheduling_latency_s":93.424124}2236gitlab # [ 447.063458] nixbot[3690]: INFO: ::ffff:127.0.0.1:45310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2237gitlab # [ 447.144753] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1b2669e617f55552ee4aa11a","created_at":"2026-09-01T10:37:24.266Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.274Z","job_size_bytes":5,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1b2669e617f55552ee4aa11a: done: 0.220029 sec","job_status":"done","queue_duration_s":93.424097,"scheduling_latency_s":93.424124,"redis_calls":12,"redis_duration_s":0.0049,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001061,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002703,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004844,"duration_s":0.220029,"completed_at":"2026-09-01T10:38:57.918Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040353,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2238gitlab # [ 447.241960] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:57.920Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"99605dc65c3b99a14ff847e9","created_at":"2026-09-01T10:37:24.307Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.312Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-99605dc65c3b99a14ff847e9: start","job_status":"start","queue_duration_s":93.608346,"scheduling_latency_s":93.608365}2239gitlab # [ 447.424336] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:58.197Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"99605dc65c3b99a14ff847e9","created_at":"2026-09-01T10:37:24.307Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.312Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-99605dc65c3b99a14ff847e9: done: 0.276367 sec","job_status":"done","queue_duration_s":93.608346,"scheduling_latency_s":93.608365,"redis_calls":11,"redis_duration_s":0.003369,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000793,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.232,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.232,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.168493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056844,"duration_s":0.276367,"completed_at":"2026-09-01T10:38:58.196Z","load_balancing_strategy":"primary","db_duration_s":0.110628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 447.520223] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:58.199Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a0dcca461795220c7c41835d","created_at":"2026-09-01T10:37:24.315Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.320Z","job_size_bytes":89,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a0dcca461795220c7c41835d: start","job_status":"start","queue_duration_s":93.878791,"scheduling_latency_s":93.878817}2241gitlab # [ 447.570221] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:58.249Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a0dcca461795220c7c41835d","created_at":"2026-09-01T10:37:24.315Z","trace_propagation_headers":{"sentry-trace":"12517c3f98404eda91a9519666b54432-f7971b055a2946fc","baggage":"sentry-trace_id=12517c3f98404eda91a9519666b54432,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q0K3QTCD2Z0D0019B8RV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:24.320Z","job_size_bytes":89,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a0dcca461795220c7c41835d: done: 0.05059 sec","job_status":"done","queue_duration_s":93.878791,"scheduling_latency_s":93.878817,"redis_calls":11,"redis_duration_s":0.003299,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005242,"duration_s":0.05059,"completed_at":"2026-09-01T10:38:58.249Z","load_balancing_strategy":"primary","db_duration_s":0.009687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 447.639140] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:58.251Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ed091d128df860d894fe1980a038608c243b6fec refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b970061b2ae5736a3b52eaa4","created_at":"2026-09-01T10:37:27.621Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-fc7d4267dac44869","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:27.686Z","job_size_bytes":185,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b970061b2ae5736a3b52eaa4: start","job_status":"start","queue_duration_s":90.565828,"scheduling_latency_s":90.565849}2243gitlab # [ 447.659065] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:58.272Z","message":"changes: \"0000000000000000000000000000000000000000 ed091d128df860d894fe1980a038608c243b6fec refs/heads/master\\n\""}2244gitlab # [ 447.662436] gitaly[894]: time="2026-09-01T10:38:58.322Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:08.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:58.304" grpc.time_ms=17.836 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 447.677829] gitaly[894]: time="2026-09-01T10:38:58.344Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:39:08.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:58.328" grpc.time_ms=16.225 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 447.692807] gitaly[894]: time="2026-09-01T10:38:58.451Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:39:08.131" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:58.432" grpc.time_ms=18.906 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 447.758659] gitaly[894]: time="2026-09-01T10:38:58.533Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:38:58.531" grpc.time_ms=1.563 pid=894 span.kind=server system=grpc2248gitlab # [ 447.812995] gitaly[894]: time="2026-09-01T10:38:58.587Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:38:58.586" grpc.time_ms=0.779 pid=894 span.kind=server system=grpc2249gitlab # [ 447.837592] gitaly[894]: time="2026-09-01T10:38:58.602Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF diskcache=86e5c520-264a-413c-b4da-199890f2b881 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:08.173" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:58.473" pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2250gitlab # [ 447.858060] gitaly[894]: time="2026-09-01T10:38:58.603Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=137 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5222 command.oublock=8 command.real_time_ms=121 command.spawn_token_fork_ms=1 command.system_time_ms=73 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:08.173" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:58.473" grpc.time_ms=129.231 pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2251gitlab # [ 447.878406] gitaly[894]: time="2026-09-01T10:38:58.635Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:39:08.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:58.635" grpc.time_ms=0.328 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 447.894959] gitaly[894]: time="2026-09-01T10:38:58.669Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=857 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:39:08.013" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:58.644" grpc.time_ms=24.894 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2254gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2255gitlab # [ 448.031740] gitaly[894]: time="2026-09-01T10:38:58.805Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-01T10:39:28.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:58.792" grpc.time_ms=12.814 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 448.077344] nixbot[3690]: INFO: ::ffff:127.0.0.1:45318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2257gitlab # [ 448.085394] gitaly[894]: time="2026-09-01T10:38:58.859Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:39:08.228" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:58.859" grpc.time_ms=0.524 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 448.107905] gitaly[894]: time="2026-09-01T10:38:58.873Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:39:08.232" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:38:58.863" grpc.time_ms=10.542 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 448.137850] gitaly[894]: time="2026-09-01T10:38:58.912Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:08.265" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:58.895" grpc.time_ms=16.743 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 448.162920] gitaly[894]: time="2026-09-01T10:38:58.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:08.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:58.922" grpc.time_ms=14.409 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 448.213405] gitaly[894]: time="2026-09-01T10:38:58.987Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:28.260" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:58.960" grpc.time_ms=26.672 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 448.961462] gitaly[894]: time="2026-09-01T10:38:59.735Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:39:09.101" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:59.732" grpc.time_ms=2.666 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2264gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.07 seconds)2265gitlab # [ 449.038736] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:59.810Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ed091d128df860d894fe1980a038608c243b6fec refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b970061b2ae5736a3b52eaa4","created_at":"2026-09-01T10:37:27.621Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-fc7d4267dac44869","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:27.686Z","job_size_bytes":185,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b970061b2ae5736a3b52eaa4: done: 1.559015 sec","job_status":"done","queue_duration_s":90.565828,"scheduling_latency_s":90.565849,"gitaly_calls":13,"gitaly_duration_s":0.347302,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.070274,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006475,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009876,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002479,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005396,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028878,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01717,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.088,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.324,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.364,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.088,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.053427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073066,"exclusive_lock_hold_duration_s":0.03869334,"duration_s":1.559015,"completed_at":"2026-09-01T10:38:59.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.158356,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2266gitlab # [ 449.160872] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:59.814Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ed091d128df860d894fe1980a038608c243b6fec 25be9462d5ccd5b2da5c349a8d71cb36504f3bfa refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7184340aef0a11b49cd00cd3","created_at":"2026-09-01T10:37:34.080Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-66519ae89dce4272","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:34.082Z","job_size_bytes":185,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7184340aef0a11b49cd00cd3: start","job_status":"start","queue_duration_s":85.731723,"scheduling_latency_s":85.73176}2267gitlab # [ 449.183410] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:59.843Z","message":"changes: \"ed091d128df860d894fe1980a038608c243b6fec 25be9462d5ccd5b2da5c349a8d71cb36504f3bfa refs/heads/master\\n\""}2268gitlab # [ 449.186411] gitaly[894]: time="2026-09-01T10:38:59.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:09.258" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:59.888" grpc.time_ms=16.618 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2269gitlab # [ 449.201180] nixbot[3690]: INFO: ::ffff:127.0.0.1:45322 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2270gitlab # [ 449.203195] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:38:59.939Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"10c956f850a1be536878fa77","created_at":"2026-09-01T10:38:59.935Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"13d780ee026ba6344ca587cc","job_size_bytes":46,"pid":3631,"job_status":"deduplicated","message":"ProjectCacheWorker JID-10c956f850a1be536878fa77: deduplicated: until executing","deduplication.type":"until executing"}2271gitlab # [ 449.218258] gitaly[894]: time="2026-09-01T10:38:59.930Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:39:09.283" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:38:59.913" grpc.time_ms=15.965 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 449.231555] gitaly[894]: time="2026-09-01T10:38:59.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:39:09.044" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:59.964" grpc.time_ms=17.431 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 449.244762] gitaly[894]: time="2026-09-01T10:39:00.010Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-01T10:39:29.290" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:59.991" grpc.time_ms=18.954 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 449.267767] gitaly[894]: time="2026-09-01T10:39:00.042Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=320 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:39:10.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:39:00.030" grpc.time_ms=11.577 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 449.302315] gitaly[894]: time="2026-09-01T10:39:00.076Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:10.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:00.059" grpc.time_ms=16.633 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab # [ 449.617689] gitaly[894]: time="2026-09-01T10:39:00.391Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:39:10.230" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:00.250" grpc.time_ms=140.909 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 449.656559] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.417Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ed091d128df860d894fe1980a038608c243b6fec 25be9462d5ccd5b2da5c349a8d71cb36504f3bfa refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7184340aef0a11b49cd00cd3","created_at":"2026-09-01T10:37:34.080Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-66519ae89dce4272","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:34.082Z","job_size_bytes":185,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7184340aef0a11b49cd00cd3: done: 0.603204 sec","job_status":"done","queue_duration_s":85.731723,"scheduling_latency_s":85.73176,"gitaly_calls":7,"gitaly_duration_s":0.267551,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.037132,"redis_read_bytes":500,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.004137,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001578,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005818,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013815,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.011784,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.044,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.423463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00157036,"exclusive_lock_hold_duration_s":0.03912054,"duration_s":0.603204,"completed_at":"2026-09-01T10:39:00.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047937,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab # [ 449.751480] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.419Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c2af923fc382ac986cb16b7b","created_at":"2026-09-01T10:37:35.500Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.526Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c2af923fc382ac986cb16b7b: start","job_status":"start","queue_duration_s":84.893294,"scheduling_latency_s":84.893318}2279gitlab # [ 449.772260] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.533Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c2af923fc382ac986cb16b7b","created_at":"2026-09-01T10:37:35.500Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.526Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c2af923fc382ac986cb16b7b: done: 0.113558 sec","job_status":"done","queue_duration_s":84.893294,"scheduling_latency_s":84.893318,"redis_calls":16,"redis_duration_s":0.004718,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002547,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057596,"duration_s":0.113558,"completed_at":"2026-09-01T10:39:00.533Z","load_balancing_strategy":"primary","db_duration_s":0.037125,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2280gitlab # [ 449.822055] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.536Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e1112e0498c8b97c0e3cd35","created_at":"2026-09-01T10:37:35.529Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.551Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e1112e0498c8b97c0e3cd35: start","job_status":"start","queue_duration_s":84.984724,"scheduling_latency_s":84.984746}2281gitlab # [ 449.968078] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.741Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e1112e0498c8b97c0e3cd35","created_at":"2026-09-01T10:37:35.529Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.551Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e1112e0498c8b97c0e3cd35: done: 0.205185 sec","job_status":"done","queue_duration_s":84.984724,"scheduling_latency_s":84.984746,"redis_calls":21,"redis_duration_s":0.007892,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00341,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085902,"duration_s":0.205185,"completed_at":"2026-09-01T10:39:00.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 450.063646] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:00.744Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"859c3515652d903958a1438d","created_at":"2026-09-01T10:37:35.841Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.864Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-859c3515652d903958a1438d: start","job_status":"start","queue_duration_s":84.879931,"scheduling_latency_s":84.879967}2283gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2284gitlab # [ 450.176631] nixbot[3690]: INFO: ::ffff:127.0.0.1:45324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2285gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.07 seconds)2286gitlab # [ 450.340537] gitaly[894]: time="2026-09-01T10:39:01.113Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:01.112" grpc.time_ms=0.83 pid=894 span.kind=server system=grpc2287gitlab # [ 450.393264] gitaly[894]: time="2026-09-01T10:39:01.167Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:01.166" grpc.time_ms=0.748 pid=894 span.kind=server system=grpc2288gitlab # [ 450.447780] gitaly[894]: time="2026-09-01T10:39:01.222Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:01.221" grpc.time_ms=0.785 pid=894 span.kind=server system=grpc2289gitlab # [ 450.476233] gitaly[894]: time="2026-09-01T10:39:01.235Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 diskcache=92d05b5b-1634-4666-9832-5b015cd93652 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:31.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:01.055" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 450.497060] gitaly[894]: time="2026-09-01T10:39:01.236Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=204 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7464 command.oublock=0 command.real_time_ms=173 command.spawn_token_fork_ms=1 command.system_time_ms=129 command.user_time_ms=75 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:31.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:01.055" grpc.time_ms=180.698 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 450.710439] gitaly[894]: time="2026-09-01T10:39:01.484Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:31.482" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.482" grpc.time_ms=1.697 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 450.785458] gitaly[894]: time="2026-09-01T10:39:01.559Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QD725KAJQW7MC89JDMC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:31.557" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.558" grpc.time_ms=1.345 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 450.821113] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.592Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"859c3515652d903958a1438d","created_at":"2026-09-01T10:37:35.841Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-1a5dea92a1054d99","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:35.864Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-859c3515652d903958a1438d: done: 0.847857 sec","job_status":"done","queue_duration_s":84.879931,"scheduling_latency_s":84.879967,"gitaly_calls":3,"gitaly_duration_s":0.195853,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.04713,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002968,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002548,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017494,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006871,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008989,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001198,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000818,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003276,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.111,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.056,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.063,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.058,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.511522,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7319819399999999,"duration_s":0.847857,"completed_at":"2026-09-01T10:39:01.592Z","load_balancing_strategy":"primary","db_duration_s":0.130909,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2294gitlab # [ 450.896178] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.596Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"13d780ee026ba6344ca587cc","created_at":"2026-09-01T10:38:58.349Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.383Z","job_size_bytes":46,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-13d780ee026ba6344ca587cc: start","job_status":"start","queue_duration_s":3.212816,"scheduling_latency_s":3.212846}2295gitlab # [ 450.911612] gitaly[894]: time="2026-09-01T10:39:01.674Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-01T16:39:01.663" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:01.663" grpc.time_ms=10.051 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 450.929947] gitaly[894]: time="2026-09-01T10:39:01.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:39:31.685" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.685" grpc.time_ms=18.378 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 450.968905] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.742Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"13d780ee026ba6344ca587cc","created_at":"2026-09-01T10:38:58.349Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.383Z","job_size_bytes":46,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-13d780ee026ba6344ca587cc: done: 0.146665 sec","job_status":"done","queue_duration_s":3.212816,"scheduling_latency_s":3.212846,"gitaly_calls":2,"gitaly_duration_s":0.034846,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010211999999999999,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002789,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000736,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002085,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003606,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040398,"duration_s":0.146665,"completed_at":"2026-09-01T10:39:01.742Z","load_balancing_strategy":"primary","db_duration_s":0.018281,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2298gitlab # [ 451.018350] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.744Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"59fb73fe6158127e8334a11a","created_at":"2026-09-01T10:38:58.412Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.422Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-59fb73fe6158127e8334a11a: start","job_status":"start","queue_duration_s":3.322198,"scheduling_latency_s":3.322219}2299gitlab # [ 451.050524] gitaly[894]: time="2026-09-01T10:39:01.825Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF diskcache=a05c7091-eac1-4a8e-acb9-253c6ea1b4ae grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:01.788" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.788" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2300gitlab # [ 451.060615] gitaly[894]: time="2026-09-01T10:39:01.825Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:01.788" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.788" grpc.time_ms=36.675 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2302gitlab # [ 451.140892] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.913Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"59fb73fe6158127e8334a11a","created_at":"2026-09-01T10:38:58.412Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.422Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-59fb73fe6158127e8334a11a: done: 0.168797 sec","job_status":"done","queue_duration_s":3.322198,"scheduling_latency_s":3.322219,"gitaly_calls":1,"gitaly_duration_s":0.041187,"redis_calls":15,"redis_duration_s":0.005802,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000714,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001059,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12329633999999999,"duration_s":0.168797,"completed_at":"2026-09-01T10:39:01.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 451.207242] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:01.917Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8be43fa093dcc099bbe6ca2f","created_at":"2026-09-01T10:38:58.626Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.630Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8be43fa093dcc099bbe6ca2f: start","job_status":"start","queue_duration_s":3.286763,"scheduling_latency_s":3.286797}2304gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.05 seconds)2305gitlab # [ 451.226472] gitaly[894]: time="2026-09-01T10:39:01.988Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:39:31.268" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:01.969" grpc.time_ms=18.872 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 451.242524] nixbot[3690]: INFO: ::ffff:127.0.0.1:41144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2307gitlab # [ 451.244907] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:02.011Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8be43fa093dcc099bbe6ca2f","created_at":"2026-09-01T10:38:58.626Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:58.630Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8be43fa093dcc099bbe6ca2f: done: 0.094928 sec","job_status":"done","queue_duration_s":3.286763,"scheduling_latency_s":3.286797,"gitaly_calls":1,"gitaly_duration_s":0.022847,"redis_calls":16,"redis_duration_s":0.007549,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000494,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003165,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.094928,"completed_at":"2026-09-01T10:39:02.011Z","load_balancing_strategy":"primary","db_duration_s":0.005252,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2308gitlab # [ 451.291093] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:02.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a3a90f3a04619046c69be35f","created_at":"2026-09-01T10:38:59.423Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2abacffa559f9f0ba2c3c94711c233be3b45865422fce2aa92bb33a3ac99414b","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.436Z","job_size_bytes":467,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a3a90f3a04619046c69be35f: start","job_status":"start","queue_duration_s":2.578647,"scheduling_latency_s":2.578691}2309gitlab # [ 451.308046] gitaly[894]: time="2026-09-01T10:39:02.067Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:32.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:02.066" grpc.time_ms=1.086 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 451.319943] gitaly[894]: time="2026-09-01T10:39:02.090Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:12.052" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:02.072" grpc.time_ms=17.205 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 451.517675] gitaly[894]: time="2026-09-01T10:39:02.290Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:32.288" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:02.289" grpc.time_ms=1.433 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 451.556903] gitaly[894]: time="2026-09-01T10:39:02.299Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:39:32.294" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:02.295" grpc.time_ms=4.357 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 451.639953] gitaly[894]: time="2026-09-01T10:39:02.414Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:12.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:02.396" grpc.time_ms=17.507 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2315gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.06 seconds)2316gitlab # [ 452.290668] nixbot[3690]: INFO: ::ffff:127.0.0.1:41150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2317gitlab # [ 452.297118] gitaly[894]: time="2026-09-01T10:39:03.069Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:33.045" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.046" grpc.time_ms=23.045 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab # [ 452.338656] gitaly[894]: time="2026-09-01T10:39:03.098Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8Q4WEN00PV46AP0G33TTF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:39:33.073" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.073" grpc.time_ms=24.644 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 452.363104] sidekiq-cluster[3631]: {"severity":"WARN","time":"2026-09-01T10:39:03.135Z","class":"CreatePipelineWorker","correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"ed091d128df860d894fe1980a038608c243b6fec","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"ed091d128df860d894fe1980a038608c243b6fec","ref":"refs/heads/master"},"retry":0}2320gitlab # [ 452.374767] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a3a90f3a04619046c69be35f","created_at":"2026-09-01T10:38:59.423Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2abacffa559f9f0ba2c3c94711c233be3b45865422fce2aa92bb33a3ac99414b","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.436Z","job_size_bytes":467,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a3a90f3a04619046c69be35f: done: 1.12998 sec","job_status":"done","queue_duration_s":2.578647,"scheduling_latency_s":2.578691,"gitaly_calls":7,"gitaly_duration_s":0.112137,"redis_calls":51,"redis_duration_s":0.015232,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001652,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.00623,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003932,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.929485,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058356,"duration_s":1.12998,"completed_at":"2026-09-01T10:39:03.145Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.09057,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 452.442404] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.147Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"4647d093-ea41-4eeb-b674-f61fdf6d6b4c\"}"],"class":"WebHookWorker","jid":"91f84b042a6bc7472fd636b3","created_at":"2026-09-01T10:38:59.690Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72d72572cfa2455b6d7c4790c4cc0a3b4d6a5b1b7bfada031e35be944fde8867","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.697Z","job_size_bytes":1751,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-91f84b042a6bc7472fd636b3: start","job_status":"start","queue_duration_s":3.450266,"scheduling_latency_s":3.450288}2322gitlab # [ 452.606391] nixbot[3690]: INFO: ::ffff:127.0.0.1:41158 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2323gitlab # [ 452.646771] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.419Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"4647d093-ea41-4eeb-b674-f61fdf6d6b4c\"}"],"class":"WebHookWorker","jid":"91f84b042a6bc7472fd636b3","created_at":"2026-09-01T10:38:59.690Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-0735b9f05d064821","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72d72572cfa2455b6d7c4790c4cc0a3b4d6a5b1b7bfada031e35be944fde8867","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.697Z","job_size_bytes":1751,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-91f84b042a6bc7472fd636b3: done: 0.272645 sec","job_status":"done","queue_duration_s":3.450266,"scheduling_latency_s":3.450288,"redis_calls":19,"redis_duration_s":0.006824,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00167,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000889,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002626,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001639,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09002504000000044,"cpu_s":0.159954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008014,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.272645,"completed_at":"2026-09-01T10:39:03.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab # [ 452.761495] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.423Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45f09982f414e3de04021941","created_at":"2026-09-01T10:38:59.952Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"59fb73fe6158127e8334a11a","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.957Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45f09982f414e3de04021941: start","job_status":"start","queue_duration_s":3.465976,"scheduling_latency_s":3.466014}2325gitlab # [ 452.784328] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.510Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45f09982f414e3de04021941","created_at":"2026-09-01T10:38:59.952Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"59fb73fe6158127e8334a11a","size_limiter":"validated","enqueued_at":"2026-09-01T10:38:59.957Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45f09982f414e3de04021941: done: 0.086902 sec","job_status":"done","queue_duration_s":3.465976,"scheduling_latency_s":3.466014,"gitaly_calls":1,"gitaly_duration_s":0.020233,"redis_calls":12,"redis_duration_s":0.005513,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000962,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001532,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04836122,"duration_s":0.086902,"completed_at":"2026-09-01T10:39:03.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 452.838243] gitaly[894]: time="2026-09-01T10:39:03.474Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW diskcache=3a8ab032-8870-4097-b864-2ebef40be906 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:03.460" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.461" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab # [ 452.848367] gitaly[894]: time="2026-09-01T10:39:03.475Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:03.460" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.461" grpc.time_ms=13.352 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 452.861297] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:03.512Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"453b294a506400122d21b39a","created_at":"2026-09-01T10:39:00.177Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6f29cf47e8d01a6b66a16c768ab10e6052d38e5b5fa3d859dd9f021e649c12f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:00.182Z","job_size_bytes":467,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-453b294a506400122d21b39a: start","job_status":"start","queue_duration_s":3.330004,"scheduling_latency_s":3.330031}2329gitlab # [ 452.878549] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1912330gitlab # [ 452.880621] gitaly[894]: time="2026-09-01T10:39:03.552Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:33.549" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.550" grpc.time_ms=2.192 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 452.892570] gitaly[894]: time="2026-09-01T10:39:03.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:13.165" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:03.555" grpc.time_ms=16.082 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 452.905411] gitaly[894]: time="2026-09-01T10:39:03.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T3R4QSQ6CE5YG0M9MR2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:03.601" grpc.time_ms=16.864 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2333gitlab # [ 452.918576] gitaly[894]: time="2026-09-01T10:39:03.628Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:33.625" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.627" grpc.time_ms=1.268 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 452.931097] gitaly[894]: time="2026-09-01T10:39:03.639Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=176 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:39:33.635" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.636" grpc.time_ms=3.529 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 452.946850] gitaly[894]: time="2026-09-01T10:39:03.709Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:13.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:03.695" grpc.time_ms=13.599 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 452.959911] gitaly[894]: time="2026-09-01T10:39:03.723Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T3Y6PWNPSGCQMP44KXZR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:03.712" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2337gitlab # [ 452.970047] gitlab-workhorse[821]: time="2026-09-01T10:39:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672338gitlab # [ 452.971808] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1022339gitlab # [ 452.973774] gitaly[894]: time="2026-09-01T10:39:03.724Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T3Y6PWNPSGCQMP44KXZR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:03.712" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2340gitlab # [ 452.987771] gitaly[894]: time="2026-09-01T10:39:03.724Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T3Y6PWNPSGCQMP44KXZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:03.712" grpc.time_ms=11.591 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2341gitlab # [ 453.002268] nixbot[3690]: {"ts": "2026-09-01T10:39:03.769Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2342gitlab # [ 453.098519] gitaly[894]: time="2026-09-01T10:39:03.872Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:33.471" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:03.871" grpc.time_ms=1.064 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2344gitlab # [ 453.259517] gitaly[894]: time="2026-09-01T10:39:04.033Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:14.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:04.015" grpc.time_ms=18.261 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 453.359928] nixbot[3690]: INFO: ::ffff:127.0.0.1:41160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2346gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.08 seconds)2347gitlab # [ 453.367288] nixbot[3690]: {"ts": "2026-09-01T10:39:04.139Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}2348gitlab # [ 453.376195] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3522349gitlab # [ 453.448464] gitaly[894]: time="2026-09-01T10:39:04.222Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4EM79DNCXTSJJVJ2F6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:34.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:04.221" grpc.time_ms=0.867 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 453.511695] gitaly[894]: time="2026-09-01T10:39:04.285Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4EM79DNCXTSJJVJ2F6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:14.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:04.269" grpc.time_ms=15.654 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 453.579603] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2052352gitlab # [ 453.589814] nixbot[3690]: {"ts": "2026-09-01T10:39:04.364Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}2353gitlab # [ 453.621101] gitaly[894]: time="2026-09-01T10:39:04.395Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:34.380" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:04.381" grpc.time_ms=14.012 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 453.662261] gitaly[894]: time="2026-09-01T10:39:04.413Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QC0DMQZ4TGJMWHA85EYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:39:34.398" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:04.398" grpc.time_ms=14.627 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 453.686985] sidekiq-cluster[3631]: {"severity":"WARN","time":"2026-09-01T10:39:04.428Z","class":"CreatePipelineWorker","correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"ed091d128df860d894fe1980a038608c243b6fec","after":"25be9462d5ccd5b2da5c349a8d71cb36504f3bfa","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"25be9462d5ccd5b2da5c349a8d71cb36504f3bfa","ref":"refs/heads/master"},"retry":0}2356gitlab # [ 453.697450] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"453b294a506400122d21b39a","created_at":"2026-09-01T10:39:00.177Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d6f29cf47e8d01a6b66a16c768ab10e6052d38e5b5fa3d859dd9f021e649c12f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:00.182Z","job_size_bytes":467,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-453b294a506400122d21b39a: done: 0.922063 sec","job_status":"done","queue_duration_s":3.330004,"scheduling_latency_s":3.330031,"gitaly_calls":7,"gitaly_duration_s":0.09002,"redis_calls":33,"redis_duration_s":0.01049,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.002041,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003646,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.801736,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.922063,"completed_at":"2026-09-01T10:39:04.434Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034294,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2357gitlab # [ 453.759670] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.437Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5d5dc075-463b-45dc-a460-482425bb61fd\"}"],"class":"WebHookWorker","jid":"863e2edc205ff28d7f8e30df","created_at":"2026-09-01T10:39:00.217Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e063e9dcbed4ee72d88703252278721bc18e7daf8638ea5d57f497c25b85bfb","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:00.222Z","job_size_bytes":1749,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-863e2edc205ff28d7f8e30df: start","job_status":"start","queue_duration_s":4.214105,"scheduling_latency_s":4.214129}2358gitlab # [ 453.778295] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.488Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5d5dc075-463b-45dc-a460-482425bb61fd\"}"],"class":"WebHookWorker","jid":"863e2edc205ff28d7f8e30df","created_at":"2026-09-01T10:39:00.217Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-7cadc70c216d43c6","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e063e9dcbed4ee72d88703252278721bc18e7daf8638ea5d57f497c25b85bfb","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:00.222Z","job_size_bytes":1749,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-863e2edc205ff28d7f8e30df: done: 0.051559 sec","job_status":"done","queue_duration_s":4.214105,"scheduling_latency_s":4.214129,"redis_calls":14,"redis_duration_s":0.006085,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.001396,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002919,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.012025260000029903,"cpu_s":0.025936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.051559,"completed_at":"2026-09-01T10:39:04.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 453.825920] nixbot[3690]: INFO: ::ffff:127.0.0.1:41164 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2360gitlab # [ 453.827190] gitaly[894]: time="2026-09-01T10:39:04.498Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4NPZPCS53HDCDYNCPWM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:34.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:04.497" grpc.time_ms=1.178 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2361gitlab # [ 453.840114] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97526bcd4572b0fe54e93f51","created_at":"2026-09-01T10:39:01.024Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.034Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97526bcd4572b0fe54e93f51: start","job_status":"start","queue_duration_s":3.457211,"scheduling_latency_s":3.457233}2362gitlab # [ 453.856494] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 842363gitlab # [ 453.858881] gitaly[894]: time="2026-09-01T10:39:04.571Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4NPZPCS53HDCDYNCPWM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:14.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:04.560" grpc.time_ms=10.91 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2364gitlab # [ 453.872173] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97526bcd4572b0fe54e93f51","created_at":"2026-09-01T10:39:01.024Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.034Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97526bcd4572b0fe54e93f51: done: 0.124001 sec","job_status":"done","queue_duration_s":3.457211,"scheduling_latency_s":3.457233,"redis_calls":10,"redis_duration_s":0.009179,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001962,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056034,"duration_s":0.124001,"completed_at":"2026-09-01T10:39:04.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032735,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 453.916357] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.619Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a93e586853949e35e5722898","created_at":"2026-09-01T10:39:01.247Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.259Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a93e586853949e35e5722898: start","job_status":"start","queue_duration_s":3.359556,"scheduling_latency_s":3.35958}2366gitlab # [ 453.932584] gitaly[894]: time="2026-09-01T10:39:04.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4SZZ33ASW1WS6T873K2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.582" grpc.time_ms=12.535 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2367gitlab # [ 453.945615] gitaly[894]: time="2026-09-01T10:39:04.668Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4WMA9QQCQ3EMHY1TZAG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.658" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2368gitlab # [ 453.955764] nixbot[3690]: {"ts": "2026-09-01T10:39:04.667Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec \"HTTP/1.1 201 Created\""}2369gitlab # [ 453.958707] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.659Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a93e586853949e35e5722898","created_at":"2026-09-01T10:39:01.247Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.259Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a93e586853949e35e5722898: done: 0.039546 sec","job_status":"done","queue_duration_s":3.359556,"scheduling_latency_s":3.35958,"redis_calls":10,"redis_duration_s":0.002022,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037176,"duration_s":0.039546,"completed_at":"2026-09-01T10:39:04.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 454.002482] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"290f99956cbcd5d948fd6077","created_at":"2026-09-01T10:39:01.284Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.298Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-290f99956cbcd5d948fd6077: start","job_status":"start","queue_duration_s":3.364651,"scheduling_latency_s":3.364671}2371gitlab # [ 454.018751] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ed091d128df860d894fe1980a038608c243b6fec HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2882372gitlab # [ 454.022426] gitlab-workhorse[821]: time="2026-09-01T10:39:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672373gitlab # [ 454.024251] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722374gitlab # [ 454.026069] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 792375gitlab # [ 454.028110] gitaly[894]: time="2026-09-01T10:39:04.668Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4WMA9QQCQ3EMHY1TZAG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.658" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2376gitlab # [ 454.041002] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"290f99956cbcd5d948fd6077","created_at":"2026-09-01T10:39:01.284Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.298Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-290f99956cbcd5d948fd6077: done: 0.049404 sec","job_status":"done","queue_duration_s":3.364651,"scheduling_latency_s":3.364671,"redis_calls":10,"redis_duration_s":0.002278,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001519,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022426,"duration_s":0.049404,"completed_at":"2026-09-01T10:39:04.712Z","load_balancing_strategy":"primary","db_duration_s":0.006242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 454.084336] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.714Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"27ae269960567debf0bf9dd7","created_at":"2026-09-01T10:39:01.325Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.335Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-27ae269960567debf0bf9dd7: start","job_status":"start","queue_duration_s":3.379493,"scheduling_latency_s":3.379519}2378gitlab # [ 454.100497] gitaly[894]: time="2026-09-01T10:39:04.668Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4WMA9QQCQ3EMHY1TZAG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.658" grpc.time_ms=9.855 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2379gitlab # [ 454.114620] gitlab-workhorse[821]: time="2026-09-01T10:39:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672380gitlab # [ 454.116479] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 642381gitlab # [ 454.118365] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.759Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"27ae269960567debf0bf9dd7","created_at":"2026-09-01T10:39:01.325Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.335Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-27ae269960567debf0bf9dd7: done: 0.044574 sec","job_status":"done","queue_duration_s":3.379493,"scheduling_latency_s":3.379519,"redis_calls":13,"redis_duration_s":0.002056,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000355,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000342,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024086,"duration_s":0.044574,"completed_at":"2026-09-01T10:39:04.759Z","load_balancing_strategy":"primary","db_duration_s":0.005372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 454.162147] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.760Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"40e4c28a8e2b0c51b6a6bc89","created_at":"2026-09-01T10:39:01.336Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.344Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-40e4c28a8e2b0c51b6a6bc89: start","job_status":"start","queue_duration_s":3.415755,"scheduling_latency_s":3.415773}2383gitlab # [ 454.178737] gitaly[894]: time="2026-09-01T10:39:04.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T500SYTENGTMG2PGATHS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.775" grpc.time_ms=7.408 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2384gitlab # [ 454.191476] gitaly[894]: time="2026-09-01T10:39:04.849Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T52HMAA9R8SAX52K1TRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.840" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2385gitlab # [ 454.201645] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"40e4c28a8e2b0c51b6a6bc89","created_at":"2026-09-01T10:39:01.336Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.344Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-40e4c28a8e2b0c51b6a6bc89: done: 0.038789 sec","job_status":"done","queue_duration_s":3.415755,"scheduling_latency_s":3.415773,"redis_calls":10,"redis_duration_s":0.001395,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002715,"duration_s":0.038789,"completed_at":"2026-09-01T10:39:04.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 454.246788] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f28504abd780be74ee59bc22","created_at":"2026-09-01T10:39:01.345Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.358Z","job_size_bytes":19,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f28504abd780be74ee59bc22: start","job_status":"start","queue_duration_s":3.442787,"scheduling_latency_s":3.442804}2387gitlab # [ 454.262733] gitaly[894]: time="2026-09-01T10:39:04.849Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T52HMAA9R8SAX52K1TRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.840" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2388gitlab # [ 454.275902] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862389gitlab # [ 454.278227] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f28504abd780be74ee59bc22","created_at":"2026-09-01T10:39:01.345Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.358Z","job_size_bytes":19,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f28504abd780be74ee59bc22: done: 0.032482 sec","job_status":"done","queue_duration_s":3.442787,"scheduling_latency_s":3.442804,"redis_calls":11,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028354,"duration_s":0.032482,"completed_at":"2026-09-01T10:39:04.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 454.322776] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.834Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1e58cf8d608e0b6b0836e9f5","created_at":"2026-09-01T10:39:01.365Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.376Z","job_size_bytes":66,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1e58cf8d608e0b6b0836e9f5: start","job_status":"start","queue_duration_s":3.457825,"scheduling_latency_s":3.457842}2391gitlab # [ 454.344297] gitaly[894]: time="2026-09-01T10:39:04.849Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T52HMAA9R8SAX52K1TRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.840" grpc.time_ms=8.962 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2392gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa'2393gitlab # [ 454.358494] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.870Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1e58cf8d608e0b6b0836e9f5","created_at":"2026-09-01T10:39:01.365Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.376Z","job_size_bytes":66,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1e58cf8d608e0b6b0836e9f5: done: 0.035727 sec","job_status":"done","queue_duration_s":3.457825,"scheduling_latency_s":3.457842,"redis_calls":10,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023892,"duration_s":0.035727,"completed_at":"2026-09-01T10:39:04.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 454.401005] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.871Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c48623197da3ac4b0b13e1e4","created_at":"2026-09-01T10:39:01.379Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.389Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c48623197da3ac4b0b13e1e4: start","job_status":"start","queue_duration_s":3.482135,"scheduling_latency_s":3.482152}2395gitlab # [ 454.417054] gitlab-workhorse[821]: time="2026-09-01T10:39:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162396gitlab # [ 454.419097] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 822397gitlab # [ 454.421189] gitaly[894]: time="2026-09-01T10:39:04.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T55TXDWGN26FM2MWD6GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:04.959" grpc.time_ms=17.163 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2398gitlab # [ 454.435420] gitaly[894]: time="2026-09-01T10:39:05.060Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T58KAX3QAYNWBMYW7N3G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:05.041" pid=894 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2399gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', in 0.12 seconds)2400gitlab # [ 454.445609] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.917Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c48623197da3ac4b0b13e1e4","created_at":"2026-09-01T10:39:01.379Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.389Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c48623197da3ac4b0b13e1e4: done: 0.045502 sec","job_status":"done","queue_duration_s":3.482135,"scheduling_latency_s":3.482152,"redis_calls":10,"redis_duration_s":0.001669,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043364,"duration_s":0.045502,"completed_at":"2026-09-01T10:39:04.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401(finished: subtest: push delivers the webhook, in 91.93 seconds)2402subtest: eval and build post commit statuses2403gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2404gitlab # [ 454.488714] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c663021688278edf2d07aca","created_at":"2026-09-01T10:39:01.405Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.416Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c663021688278edf2d07aca: start","job_status":"start","queue_duration_s":3.501775,"scheduling_latency_s":3.501791}2405gitlab # [ 454.504361] gitaly[894]: time="2026-09-01T10:39:05.060Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T58KAX3QAYNWBMYW7N3G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:05.041" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2406gitlab # [ 454.518450] nixbot[3690]: INFO: ::ffff:127.0.0.1:41172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 200 OK2407gitlab # [ 454.520470] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.954Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c663021688278edf2d07aca","created_at":"2026-09-01T10:39:01.405Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.416Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c663021688278edf2d07aca: done: 0.036214 sec","job_status":"done","queue_duration_s":3.501775,"scheduling_latency_s":3.501791,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026324,"duration_s":0.036214,"completed_at":"2026-09-01T10:39:04.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 454.563803] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.955Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"748286db924d55dc7e4e4b9f","created_at":"2026-09-01T10:39:01.418Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.428Z","job_size_bytes":6,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-748286db924d55dc7e4e4b9f: start","job_status":"start","queue_duration_s":3.526874,"scheduling_latency_s":3.52689}2409gitlab # [ 454.579739] gitaly[894]: time="2026-09-01T10:39:05.069Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T58KAX3QAYNWBMYW7N3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:05.041" grpc.time_ms=19.603 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2410gitlab # [ 454.595042] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"748286db924d55dc7e4e4b9f","created_at":"2026-09-01T10:39:01.418Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.428Z","job_size_bytes":6,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-748286db924d55dc7e4e4b9f: done: 0.023909 sec","job_status":"done","queue_duration_s":3.526874,"scheduling_latency_s":3.52689,"redis_calls":10,"redis_duration_s":0.00172,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000587,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023766,"duration_s":0.023909,"completed_at":"2026-09-01T10:39:04.979Z","load_balancing_strategy":"primary","db_duration_s":0.001956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 454.638862] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:04.980Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"42efd8e6d8174768985c257e","created_at":"2026-09-01T10:39:01.430Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.439Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-42efd8e6d8174768985c257e: start","job_status":"start","queue_duration_s":3.541796,"scheduling_latency_s":3.541812}2412gitlab # [ 454.654111] gitaly[894]: time="2026-09-01T10:39:05.338Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:05.338" grpc.time_ms=0.513 pid=894 span.kind=server system=grpc2413gitlab # [ 454.663613] gitaly[894]: time="2026-09-01T10:39:05.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:05.387" grpc.time_ms=1.242 pid=894 span.kind=server system=grpc2414gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.18 seconds)2415gitlab # [ 454.672979] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"42efd8e6d8174768985c257e","created_at":"2026-09-01T10:39:01.430Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.439Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-42efd8e6d8174768985c257e: done: 0.036797 sec","job_status":"done","queue_duration_s":3.541796,"scheduling_latency_s":3.541812,"redis_calls":10,"redis_duration_s":0.001678,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023324,"duration_s":0.036797,"completed_at":"2026-09-01T10:39:05.017Z","load_balancing_strategy":"primary","db_duration_s":0.006313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 454.716039] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.018Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d63bac844824514eaf4fa0a7","created_at":"2026-09-01T10:39:01.451Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.460Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d63bac844824514eaf4fa0a7: start","job_status":"start","queue_duration_s":3.557944,"scheduling_latency_s":3.557962}2417gitlab # [ 454.731677] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1112418gitlab # [ 454.734544] gitaly[894]: time="2026-09-01T10:39:05.393Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:35.091" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:05.391" grpc.time_ms=1.366 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab # [ 454.747225] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.090Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d63bac844824514eaf4fa0a7","created_at":"2026-09-01T10:39:01.451Z","trace_propagation_headers":{"sentry-trace":"2884d59e40d34cdcbbfedb4243156d90-d1ea73feb522429d","baggage":"sentry-trace_id=2884d59e40d34cdcbbfedb4243156d90,sentry-release=Unknown"},"correlation_id":"01M1E8QD725KAJQW7MC89JDMC3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.460Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d63bac844824514eaf4fa0a7: done: 0.0713 sec","job_status":"done","queue_duration_s":3.557944,"scheduling_latency_s":3.557962,"redis_calls":14,"redis_duration_s":0.005409000000000001,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00129764,"duration_s":0.0713,"completed_at":"2026-09-01T10:39:05.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2420gitlab # [ 454.790892] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ded0f62517bbb9d2de845d7a","created_at":"2026-09-01T10:39:01.718Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-d521767d4a7243c8","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.725Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ded0f62517bbb9d2de845d7a: start","job_status":"start","queue_duration_s":3.365917,"scheduling_latency_s":3.365932}2421gitlab # [ 454.806634] gitaly[894]: time="2026-09-01T10:39:05.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5KCZRRE6EB8S3R0C6ZA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:35.200" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:05.401" grpc.time_ms=0.669 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2422gitlab # [ 454.819233] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.140Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ded0f62517bbb9d2de845d7a","created_at":"2026-09-01T10:39:01.718Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-d521767d4a7243c8","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:01.725Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ded0f62517bbb9d2de845d7a: done: 0.049323 sec","job_status":"done","queue_duration_s":3.365917,"scheduling_latency_s":3.365932,"redis_calls":19,"redis_duration_s":0.002999,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000419,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00816776,"duration_s":0.049323,"completed_at":"2026-09-01T10:39:05.140Z","load_balancing_strategy":"primary","db_duration_s":0.006862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 454.864830] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.142Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","91f84b042a6bc7472fd636b3"],"class":"WebHooks::LogExecutionWorker","jid":"276c36a091e9bfb0cd6b4460","created_at":"2026-09-01T10:39:03.386Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-d3566193f92b4ef6","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f16549f3a6784fb8a34a07db797543c4cbd3750bd41044aa4219a5333e43ced3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:03.400Z","job_size_bytes":2593,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-276c36a091e9bfb0cd6b4460: start","job_status":"start","queue_duration_s":1.742327,"scheduling_latency_s":1.742345}2424gitlab # [ 454.882849] gitaly[894]: time="2026-09-01T10:39:05.419Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:39:35.006" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:05.406" grpc.time_ms=12.618 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2425gitlab # [ 454.896629] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.206Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","91f84b042a6bc7472fd636b3"],"class":"WebHooks::LogExecutionWorker","jid":"276c36a091e9bfb0cd6b4460","created_at":"2026-09-01T10:39:03.386Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-d3566193f92b4ef6","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f16549f3a6784fb8a34a07db797543c4cbd3750bd41044aa4219a5333e43ced3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:03.400Z","job_size_bytes":2593,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-276c36a091e9bfb0cd6b4460: done: 0.064228 sec","job_status":"done","queue_duration_s":1.742327,"scheduling_latency_s":1.742345,"redis_calls":10,"redis_duration_s":0.00156,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025796,"duration_s":0.064228,"completed_at":"2026-09-01T10:39:05.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 454.940273] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4275d264b935f136fdd2bb2","created_at":"2026-09-01T10:39:04.098Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-d8187911eadb463f","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:04.107Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a4275d264b935f136fdd2bb2: start","job_status":"start","queue_duration_s":1.100012,"scheduling_latency_s":1.100034}2427gitlab # [ 454.955768] gitaly[894]: time="2026-09-01T10:39:05.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:15.295" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:05.426" grpc.time_ms=10.947 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2428gitlab # [ 454.968947] gitaly[894]: time="2026-09-01T10:39:05.443Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:05.441" grpc.time_ms=0.412 pid=894 span.kind=server system=grpc2429gitlab # [ 454.978303] nixbot[3690]: {"ts": "2026-09-01T10:39:05.683Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa \"HTTP/1.1 201 Created\""}2430gitlab # [ 454.981048] nixbot[3690]: {"ts": "2026-09-01T10:39:05.704Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-25be9462d5cc-4"}2431gitlab # [ 454.983250] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4275d264b935f136fdd2bb2","created_at":"2026-09-01T10:39:04.098Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-d8187911eadb463f","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:04.107Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3631,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a4275d264b935f136fdd2bb2: rescheduled"}2432gitlab # [ 454.997967] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.569Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4275d264b935f136fdd2bb2","created_at":"2026-09-01T10:39:04.098Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-d8187911eadb463f","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:04.107Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a4275d264b935f136fdd2bb2: done: 0.361677 sec","job_status":"done","queue_duration_s":1.100012,"scheduling_latency_s":1.100034,"gitaly_calls":3,"gitaly_duration_s":0.155575,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016475999999999998,"redis_read_bytes":148,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00051,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001267,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003362,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.007883,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000252,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001243,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143571,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.31756982,"duration_s":0.361677,"completed_at":"2026-09-01T10:39:05.569Z","load_balancing_strategy":"primary","db_duration_s":0.052676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2433gitlab # [ 455.048425] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5682434gitlab # [ 455.052036] gitaly[894]: time="2026-09-01T10:39:05.450Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E diskcache=72cbfd40-6eba-4201-a0f8-32b9ef0f4fbc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:35.302" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:05.303" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2435gitlab # [ 455.061498] gitaly[894]: time="2026-09-01T10:39:05.450Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=101 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7185 command.oublock=0 command.real_time_ms=143 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:35.302" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:05.303" grpc.time_ms=147.212 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2436gitlab # [ 455.074295] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.571Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","863e2edc205ff28d7f8e30df"],"class":"WebHooks::LogExecutionWorker","jid":"31ef354f89bc06bae4deb801","created_at":"2026-09-01T10:39:04.476Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-3b22da37dcb84fb4","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:65a1ec0a9b82ba99c10d2f7a72369cb336d4673f63e8108bc84fb2b37f375c10","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:04.479Z","job_size_bytes":2592,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-31ef354f89bc06bae4deb801: start","job_status":"start","queue_duration_s":1.09202,"scheduling_latency_s":1.092045}2437gitlab # [ 455.090527] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.597Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","863e2edc205ff28d7f8e30df"],"class":"WebHooks::LogExecutionWorker","jid":"31ef354f89bc06bae4deb801","created_at":"2026-09-01T10:39:04.476Z","trace_propagation_headers":{"sentry-trace":"aeafd944c3e54a919ae1384dde59d2dc-3b22da37dcb84fb4","baggage":"sentry-trace_id=aeafd944c3e54a919ae1384dde59d2dc,sentry-release=Unknown"},"correlation_id":"01M1E8QC0DMQZ4TGJMWHA85EYW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:65a1ec0a9b82ba99c10d2f7a72369cb336d4673f63e8108bc84fb2b37f375c10","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:04.479Z","job_size_bytes":2592,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-31ef354f89bc06bae4deb801: done: 0.026516 sec","job_status":"done","queue_duration_s":1.09202,"scheduling_latency_s":1.092045,"redis_calls":7,"redis_duration_s":0.001288,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026516,"completed_at":"2026-09-01T10:39:05.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2438gitlab # [ 455.132665] gitaly[894]: time="2026-09-01T10:39:05.481Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:39:15.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:05.481" grpc.time_ms=0.242 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2439gitlab # [ 455.143071] nixbot[3690]: {"ts": "2026-09-01T10:39:05.853Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-25be9462d5cc-4", "argv0": "bwrap"}2440gitlab # [ 455.145515] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"87d11027d1dff3718f0efc7c","created_at":"2026-09-01T10:39:05.126Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-c421bd41f8634d34","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.132Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-87d11027d1dff3718f0efc7c: start","job_status":"start","queue_duration_s":0.467385,"scheduling_latency_s":0.467404}2441gitlab # [ 455.162045] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.711Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"87d11027d1dff3718f0efc7c","created_at":"2026-09-01T10:39:05.126Z","trace_propagation_headers":{"sentry-trace":"9f9a82a35ba044559a384ebfa7067daa-c421bd41f8634d34","baggage":"sentry-trace_id=9f9a82a35ba044559a384ebfa7067daa,sentry-release=Unknown"},"correlation_id":"01M1E8Q4WEN00PV46AP0G33TTF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.132Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-87d11027d1dff3718f0efc7c: done: 0.111815 sec","job_status":"done","queue_duration_s":0.467385,"scheduling_latency_s":0.467404,"redis_calls":11,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027614,"duration_s":0.111815,"completed_at":"2026-09-01T10:39:05.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2442gitlab # [ 455.205814] gitaly[894]: time="2026-09-01T10:39:05.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:15.016" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:05.486" grpc.time_ms=7.18 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2443gitlab # [ 455.218841] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ccc2b61204744ba5f037172c","created_at":"2026-09-01T10:39:05.290Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.295Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ccc2b61204744ba5f037172c: start","job_status":"start","queue_duration_s":0.417536,"scheduling_latency_s":0.417558}2444gitlab # [ 455.235032] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.765Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"ccc2b61204744ba5f037172c","created_at":"2026-09-01T10:39:05.290Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.295Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-ccc2b61204744ba5f037172c: done: 0.052536 sec","job_status":"done","queue_duration_s":0.417536,"scheduling_latency_s":0.417558,"redis_calls":7,"redis_duration_s":0.00223,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052536,"completed_at":"2026-09-01T10:39:05.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013939,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2445gitlab # [ 455.278601] gitaly[894]: time="2026-09-01T10:39:05.516Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:35.515" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:05.515" grpc.time_ms=0.882 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2446gitlab # [ 455.291337] gitaly[894]: time="2026-09-01T10:39:05.527Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:05.526" grpc.time_ms=0.615 pid=894 span.kind=server system=grpc2447gitlab # [ 455.301025] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.767Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"737d893ec9ec619052ee4338","created_at":"2026-09-01T10:39:05.456Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.459Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-737d893ec9ec619052ee4338: start","job_status":"start","queue_duration_s":0.308134,"scheduling_latency_s":0.308156}2448gitlab # [ 455.317161] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.805Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"737d893ec9ec619052ee4338","created_at":"2026-09-01T10:39:05.456Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.459Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-737d893ec9ec619052ee4338: done: 0.037757 sec","job_status":"done","queue_duration_s":0.308134,"scheduling_latency_s":0.308156,"redis_calls":7,"redis_duration_s":0.0020689999999999997,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037757,"completed_at":"2026-09-01T10:39:05.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 455.360194] gitaly[894]: time="2026-09-01T10:39:05.553Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T4380H3DV9GVD71MNS6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:35.551" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:05.552" grpc.time_ms=0.592 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2450gitlab # [ 455.372375] gitaly[894]: time="2026-09-01T10:39:05.558Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:05.557" grpc.time_ms=0.87 pid=894 span.kind=server system=grpc2451gitlab # [ 455.382162] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bd29565757a510d3a189bab4","created_at":"2026-09-01T10:39:05.472Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.474Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bd29565757a510d3a189bab4: start","job_status":"start","queue_duration_s":0.33271,"scheduling_latency_s":0.332746}2452gitlab # [ 455.397783] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bd29565757a510d3a189bab4","created_at":"2026-09-01T10:39:05.472Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.474Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bd29565757a510d3a189bab4: done: 0.031368 sec","job_status":"done","queue_duration_s":0.33271,"scheduling_latency_s":0.332746,"redis_calls":7,"redis_duration_s":0.001921,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031368,"completed_at":"2026-09-01T10:39:05.838Z","load_balancing_strategy":"primary","db_duration_s":0.004723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 455.439304] gitaly[894]: time="2026-09-01T10:39:05.565Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS diskcache=df50db89-9dfe-4215-a020-0c95f6e4e54a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:15.026" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:05.497" pid=894 ref=refs/keep-around/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa remote_ip="2001:db8:1::1" revision=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa span.kind=server system=grpc username=root2454gitlab # [ 455.450623] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dcfcad3dff6d69bd9255d84a","created_at":"2026-09-01T10:39:05.484Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.486Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dcfcad3dff6d69bd9255d84a: start","job_status":"start","queue_duration_s":0.35425,"scheduling_latency_s":0.354268}2455gitlab # [ 455.467447] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dcfcad3dff6d69bd9255d84a","created_at":"2026-09-01T10:39:05.484Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.486Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dcfcad3dff6d69bd9255d84a: done: 0.043904 sec","job_status":"done","queue_duration_s":0.35425,"scheduling_latency_s":0.354268,"redis_calls":10,"redis_duration_s":0.008816,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000903,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005892,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043904,"completed_at":"2026-09-01T10:39:05.884Z","load_balancing_strategy":"primary","db_duration_s":0.009893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 455.509872] gitaly[894]: time="2026-09-01T10:39:05.565Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5194 command.oublock=8 command.real_time_ms=63 command.spawn_token_fork_ms=1 command.system_time_ms=32 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:15.026" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:05.497" grpc.time_ms=68.235 pid=894 ref=refs/keep-around/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa remote_ip="2001:db8:1::1" revision=25be9462d5ccd5b2da5c349a8d71cb36504f3bfa span.kind=server system=grpc username=root2457gitlab # [ 455.524945] nix-daemon[3927]: accepted connection from pid 4567, user nixbot2458gitlab # [ 455.525913] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4da6c50cd7e804a7377d6c1","created_at":"2026-09-01T10:39:05.486Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.489Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4da6c50cd7e804a7377d6c1: start","job_status":"start","queue_duration_s":0.396877,"scheduling_latency_s":0.396895}2459gitlab # [ 455.542039] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4da6c50cd7e804a7377d6c1","created_at":"2026-09-01T10:39:05.486Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.489Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4da6c50cd7e804a7377d6c1: done: 0.030071 sec","job_status":"done","queue_duration_s":0.396877,"scheduling_latency_s":0.396895,"redis_calls":7,"redis_duration_s":0.0020800000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030071,"completed_at":"2026-09-01T10:39:05.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2460gitlab # [ 455.583587] gitaly[894]: time="2026-09-01T10:39:05.570Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:35.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:05.569" grpc.time_ms=1.141 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2461gitlab # [ 455.596221] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.917Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a092662350e62a217e48943c","created_at":"2026-09-01T10:39:05.489Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.493Z","job_size_bytes":19,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a092662350e62a217e48943c: start","job_status":"start","queue_duration_s":0.424256,"scheduling_latency_s":0.424273}2462gitlab # [ 455.611902] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a092662350e62a217e48943c","created_at":"2026-09-01T10:39:05.489Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.493Z","job_size_bytes":19,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a092662350e62a217e48943c: done: 0.028775 sec","job_status":"done","queue_duration_s":0.424256,"scheduling_latency_s":0.424273,"redis_calls":8,"redis_duration_s":0.002339,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028775,"completed_at":"2026-09-01T10:39:05.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 455.653386] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.947Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"abbe826629dbdf4c2f5dc345","created_at":"2026-09-01T10:39:05.494Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.496Z","job_size_bytes":66,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-abbe826629dbdf4c2f5dc345: start","job_status":"start","queue_duration_s":0.451095,"scheduling_latency_s":0.451112}2464gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2465gitlab # [ 455.671616] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.972Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"abbe826629dbdf4c2f5dc345","created_at":"2026-09-01T10:39:05.494Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.496Z","job_size_bytes":66,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-abbe826629dbdf4c2f5dc345: done: 0.02503 sec","job_status":"done","queue_duration_s":0.451095,"scheduling_latency_s":0.451112,"redis_calls":7,"redis_duration_s":0.0018249999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02503,"completed_at":"2026-09-01T10:39:05.972Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 455.711370] gitaly[894]: time="2026-09-01T10:39:06.408Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:36.405" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:06.406" grpc.time_ms=1.483 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2467gitlab # [ 455.723925] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:05.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"42d3c8fe64943742b2fd95a4","created_at":"2026-09-01T10:39:05.497Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.499Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-42d3c8fe64943742b2fd95a4: start","job_status":"start","queue_duration_s":0.47468,"scheduling_latency_s":0.474695}2468gitlab # [ 455.740050] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.004Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"42d3c8fe64943742b2fd95a4","created_at":"2026-09-01T10:39:05.497Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.499Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-42d3c8fe64943742b2fd95a4: done: 0.029739 sec","job_status":"done","queue_duration_s":0.47468,"scheduling_latency_s":0.474695,"redis_calls":7,"redis_duration_s":0.0018570000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029739,"completed_at":"2026-09-01T10:39:06.004Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2469gitlab # [ 455.781407] gitaly[894]: time="2026-09-01T10:39:06.462Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T5CRBJEJJKFNARQP3PTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:36.459" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:06.460" grpc.time_ms=1.114 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2470gitlab # [ 455.793335] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4247abec856a9e16f0817ce4","created_at":"2026-09-01T10:39:05.500Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.502Z","job_size_bytes":6,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4247abec856a9e16f0817ce4: start","job_status":"start","queue_duration_s":0.503518,"scheduling_latency_s":0.503535}2471gitlab # [ 455.808728] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4247abec856a9e16f0817ce4","created_at":"2026-09-01T10:39:05.500Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.502Z","job_size_bytes":6,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4247abec856a9e16f0817ce4: done: 0.01474 sec","job_status":"done","queue_duration_s":0.503518,"scheduling_latency_s":0.503535,"redis_calls":7,"redis_duration_s":0.0018119999999999998,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01474,"completed_at":"2026-09-01T10:39:06.020Z","load_balancing_strategy":"primary","db_duration_s":0.000654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2472gitlab # [ 455.849854] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"16511fdd6fdc5c80eab92c3d","created_at":"2026-09-01T10:39:05.502Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.504Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-16511fdd6fdc5c80eab92c3d: start","job_status":"start","queue_duration_s":0.517461,"scheduling_latency_s":0.517476}2473gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.22 seconds)2474gitlab # [ 455.864840] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"16511fdd6fdc5c80eab92c3d","created_at":"2026-09-01T10:39:05.502Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.504Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-16511fdd6fdc5c80eab92c3d: done: 0.049214 sec","job_status":"done","queue_duration_s":0.517461,"scheduling_latency_s":0.517476,"redis_calls":7,"redis_duration_s":0.003013,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049214,"completed_at":"2026-09-01T10:39:06.070Z","load_balancing_strategy":"primary","db_duration_s":0.007728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2475gitlab # [ 455.907544] gitaly[894]: time="2026-09-01T10:39:06.602Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T6SFD4W6ZR9FAYYG3MM9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:36.400" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:06.601" grpc.time_ms=0.988 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2476gitlab # [ 455.943276] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1142477gitlab # [ 455.949329] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.073Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"bf2f556d1c6cacc32f4d1b4d","created_at":"2026-09-01T10:39:05.562Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.564Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bf2f556d1c6cacc32f4d1b4d: start","job_status":"start","queue_duration_s":0.508902,"scheduling_latency_s":0.508924}2478gitlab # [ 455.976192] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.115Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"bf2f556d1c6cacc32f4d1b4d","created_at":"2026-09-01T10:39:05.562Z","trace_propagation_headers":{"sentry-trace":"fa4adbb626474af5b5a732dcd8b47017-a3c35801cdef448c","baggage":"sentry-trace_id=fa4adbb626474af5b5a732dcd8b47017,sentry-release=Unknown"},"correlation_id":"01M1E8T4380H3DV9GVD71MNS6E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.564Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bf2f556d1c6cacc32f4d1b4d: done: 0.042799 sec","job_status":"done","queue_duration_s":0.508902,"scheduling_latency_s":0.508924,"redis_calls":8,"redis_duration_s":0.002883,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002136,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042799,"completed_at":"2026-09-01T10:39:06.115Z","load_balancing_strategy":"primary","db_duration_s":0.0073,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2479gitlab # [ 456.023958] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.117Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"04fd8e2684de538d6be24b61","created_at":"2026-09-01T10:39:05.576Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.581Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-04fd8e2684de538d6be24b61: start","job_status":"start","queue_duration_s":0.536683,"scheduling_latency_s":0.536702}2480gitlab # [ 456.041026] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.159Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"04fd8e2684de538d6be24b61","created_at":"2026-09-01T10:39:05.576Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.581Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-04fd8e2684de538d6be24b61: done: 0.041569 sec","job_status":"done","queue_duration_s":0.536683,"scheduling_latency_s":0.536702,"redis_calls":7,"redis_duration_s":0.001969,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041569,"completed_at":"2026-09-01T10:39:06.159Z","load_balancing_strategy":"primary","db_duration_s":0.009953,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2481gitlab # [ 456.083047] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.162Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"25b2049a84523046f75cf996","created_at":"2026-09-01T10:39:05.582Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.587Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-25b2049a84523046f75cf996: start","job_status":"start","queue_duration_s":0.574785,"scheduling_latency_s":0.574808}2482gitlab # [ 456.101245] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.299Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"25b2049a84523046f75cf996","created_at":"2026-09-01T10:39:05.582Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.587Z","job_size_bytes":65,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-25b2049a84523046f75cf996: done: 0.137126 sec","job_status":"done","queue_duration_s":0.574785,"scheduling_latency_s":0.574808,"redis_calls":10,"redis_duration_s":0.007146,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003264,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.137126,"completed_at":"2026-09-01T10:39:06.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 456.143751] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.301Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8cafc892cf41a0fa623db825","created_at":"2026-09-01T10:39:05.658Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.662Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8cafc892cf41a0fa623db825: start","job_status":"start","queue_duration_s":0.638703,"scheduling_latency_s":0.638734}2484gitlab # [ 456.159202] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.476Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8cafc892cf41a0fa623db825","created_at":"2026-09-01T10:39:05.658Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-072357e2a20943fb","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:05.662Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8cafc892cf41a0fa623db825: done: 0.17536 sec","job_status":"done","queue_duration_s":0.638703,"scheduling_latency_s":0.638734,"gitaly_calls":2,"gitaly_duration_s":0.009614,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009178,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001474,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001428,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000349,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002241,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000292,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000598,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121888,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12981888,"duration_s":0.17536,"completed_at":"2026-09-01T10:39:06.476Z","load_balancing_strategy":"primary","db_duration_s":0.04426,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2485gitlab # [ 456.209975] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.478Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8146a4afdf8d1e483f226980","created_at":"2026-09-01T10:39:06.384Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-73bc7459ff67451a","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:06.387Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8146a4afdf8d1e483f226980: start","job_status":"start","queue_duration_s":0.091395,"scheduling_latency_s":0.091419}2486gitlab # [ 456.225735] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:06.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8146a4afdf8d1e483f226980","created_at":"2026-09-01T10:39:06.384Z","trace_propagation_headers":{"sentry-trace":"213ea4b7d56d4af588a05d3692055b89-73bc7459ff67451a","baggage":"sentry-trace_id=213ea4b7d56d4af588a05d3692055b89,sentry-release=Unknown"},"correlation_id":"01M1E8T5CRBJEJJKFNARQP3PTS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:06.387Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8146a4afdf8d1e483f226980: done: 0.046405 sec","job_status":"done","queue_duration_s":0.091395,"scheduling_latency_s":0.091419,"redis_calls":7,"redis_duration_s":0.002157,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046405,"completed_at":"2026-09-01T10:39:06.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2487gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2488gitlab # [ 457.054806] gitaly[894]: time="2026-09-01T10:39:07.827Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T7YR5FXK1RGEXC42GJSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:37.625" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:07.826" grpc.time_ms=1.227 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2489gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.22 seconds)2490gitlab # [ 457.109780] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1462491gitlab # [ 457.187130] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:07.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7c3b42189447466ab1b01672","created_at":"2026-09-01T10:39:07.935Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16d72c7fec7be75f6baf0a920736d9ee","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:07.956Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7c3b42189447466ab1b01672: start","job_status":"start","queue_duration_s":0.003846,"scheduling_latency_s":0.0039}2492gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2493gitlab # [ 458.273176] gitaly[894]: time="2026-09-01T10:39:09.046Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8T94HG54MR6CZ4D5C7TX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:39.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:09.044" grpc.time_ms=1.151 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2494gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.21 seconds)2495gitlab # [ 458.319739] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1472496gitlab # [ 458.812559] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7c3b42189447466ab1b01672","created_at":"2026-09-01T10:39:07.935Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16d72c7fec7be75f6baf0a920736d9ee","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:07.956Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7c3b42189447466ab1b01672: done: 1.62418 sec","job_status":"done","queue_duration_s":0.003846,"scheduling_latency_s":0.0039,"redis_calls":564,"redis_duration_s":0.971525,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002832,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.964634,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.697346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.62418,"completed_at":"2026-09-01T10:39:09.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2497gitlab # [ 458.904345] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"84c9846a73fa696d9c0715de","created_at":"2026-09-01T10:39:07.971Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6446230580b32f1fab8bfb77a01ab77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:07.985Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-84c9846a73fa696d9c0715de: start","job_status":"start","queue_duration_s":1.602058,"scheduling_latency_s":1.602089}2498gitlab # [ 458.923604] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.606Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2499gitlab # [ 458.928037] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"84c9846a73fa696d9c0715de","created_at":"2026-09-01T10:39:07.971Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6446230580b32f1fab8bfb77a01ab77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:07.985Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-84c9846a73fa696d9c0715de: done: 0.028596 sec","job_status":"done","queue_duration_s":1.602058,"scheduling_latency_s":1.602089,"redis_calls":9,"redis_duration_s":0.002588,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000685,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028596,"completed_at":"2026-09-01T10:39:09.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2500gitlab # [ 458.982189] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"60379580e87618bfe2ad447e","created_at":"2026-09-01T10:39:08.001Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045e45bd41246d74ae974e0e64d25d7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.023Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-60379580e87618bfe2ad447e: start","job_status":"start","queue_duration_s":1.594056,"scheduling_latency_s":1.594079}2501gitlab # [ 458.997696] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.631Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2502gitlab # [ 459.000994] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"60379580e87618bfe2ad447e","created_at":"2026-09-01T10:39:08.001Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045e45bd41246d74ae974e0e64d25d7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.023Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-60379580e87618bfe2ad447e: done: 0.022293 sec","job_status":"done","queue_duration_s":1.594056,"scheduling_latency_s":1.594079,"redis_calls":9,"redis_duration_s":0.002278,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022293,"completed_at":"2026-09-01T10:39:09.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 459.042751] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cac0d030e70e7fa5ce04005b","created_at":"2026-09-01T10:39:08.044Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d34da5f4702ab29be6b4848be82e477a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.068Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cac0d030e70e7fa5ce04005b: start","job_status":"start","queue_duration_s":1.573363,"scheduling_latency_s":1.573383}2504gitlab # [ 459.056467] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cac0d030e70e7fa5ce04005b","created_at":"2026-09-01T10:39:08.044Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d34da5f4702ab29be6b4848be82e477a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.068Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cac0d030e70e7fa5ce04005b: done: 0.045943 sec","job_status":"done","queue_duration_s":1.573363,"scheduling_latency_s":1.573383,"redis_calls":9,"redis_duration_s":0.002849,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.045943,"completed_at":"2026-09-01T10:39:09.687Z","load_balancing_strategy":"primary","db_duration_s":0.019133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 459.098374] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3ac1a10449df36d781c6f2f8","created_at":"2026-09-01T10:39:08.088Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c01d9257439a9b64a4ebf27ea2cb6928","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.108Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3ac1a10449df36d781c6f2f8: start","job_status":"start","queue_duration_s":1.58099,"scheduling_latency_s":1.581015}2506gitlab # [ 459.112635] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3ac1a10449df36d781c6f2f8","created_at":"2026-09-01T10:39:08.088Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c01d9257439a9b64a4ebf27ea2cb6928","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.108Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3ac1a10449df36d781c6f2f8: done: 0.030396 sec","job_status":"done","queue_duration_s":1.58099,"scheduling_latency_s":1.581015,"redis_calls":11,"redis_duration_s":0.0031590000000000003,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063318,"exclusive_lock_hold_duration_s":0.00399596,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.030396,"completed_at":"2026-09-01T10:39:09.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 459.155456] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5146243a105f0d5835a843d","created_at":"2026-09-01T10:39:08.127Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5eed63aef7b7d1c55bc3ac57124f7ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.148Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5146243a105f0d5835a843d: start","job_status":"start","queue_duration_s":1.573143,"scheduling_latency_s":1.573163}2508gitlab # [ 459.170150] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b5146243a105f0d5835a843d","created_at":"2026-09-01T10:39:08.127Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5eed63aef7b7d1c55bc3ac57124f7ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.148Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b5146243a105f0d5835a843d: done: 0.033273 sec","job_status":"done","queue_duration_s":1.573143,"scheduling_latency_s":1.573163,"redis_calls":11,"redis_duration_s":0.003599,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055102,"exclusive_lock_hold_duration_s":0.00856952,"duration_s":0.033273,"completed_at":"2026-09-01T10:39:09.755Z","load_balancing_strategy":"primary","db_duration_s":0.005156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 459.210747] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"2ee21f6dd1783e6cc13b30a3","created_at":"2026-09-01T10:39:08.173Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84ec6081a2c9096bc3913f92e53d5cf2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:39:08.195Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-2ee21f6dd1783e6cc13b30a3: start","job_status":"start","queue_duration_s":1.561039,"scheduling_latency_s":1.561056}2510gitlab # [ 459.224167] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.770Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2511gitlab # [ 459.227687] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"2ee21f6dd1783e6cc13b30a3","created_at":"2026-09-01T10:39:08.173Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84ec6081a2c9096bc3913f92e53d5cf2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:39:08.195Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-2ee21f6dd1783e6cc13b30a3: done: 0.032789 sec","job_status":"done","queue_duration_s":1.561039,"scheduling_latency_s":1.561056,"redis_calls":9,"redis_duration_s":0.002649,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032789,"completed_at":"2026-09-01T10:39:09.789Z","load_balancing_strategy":"primary","db_duration_s":0.000727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2512gitlab # [ 459.268143] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8bf0c99707a600d5533d9f42","created_at":"2026-09-01T10:39:08.228Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.256Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8bf0c99707a600d5533d9f42: start","job_status":"start","queue_duration_s":1.5368,"scheduling_latency_s":1.53684}2513gitlab # [ 459.281386] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8bf0c99707a600d5533d9f42","created_at":"2026-09-01T10:39:08.228Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.256Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8bf0c99707a600d5533d9f42: done: 0.160919 sec","job_status":"done","queue_duration_s":1.5368,"scheduling_latency_s":1.53684,"redis_calls":70,"redis_duration_s":0.02214,"redis_read_bytes":118,"redis_write_bytes":42480,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003285,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001125,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.016862,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.160919,"completed_at":"2026-09-01T10:39:09.953Z","load_balancing_strategy":"primary","db_duration_s":0.004283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2514gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2515gitlab # [ 459.323461] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4376e181af0ea85a1484f07a","created_at":"2026-09-01T10:39:08.283Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"971c6b678072726ed8909f38bfd5da48","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.310Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4376e181af0ea85a1484f07a: start","job_status":"start","queue_duration_s":1.645521,"scheduling_latency_s":1.645538}2516gitlab # [ 459.337016] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4376e181af0ea85a1484f07a","created_at":"2026-09-01T10:39:08.283Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"971c6b678072726ed8909f38bfd5da48","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.310Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4376e181af0ea85a1484f07a: done: 0.034723 sec","job_status":"done","queue_duration_s":1.645521,"scheduling_latency_s":1.645538,"redis_calls":12,"redis_duration_s":0.003168,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001573,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01029512,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034723,"completed_at":"2026-09-01T10:39:09.990Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2517gitlab # [ 459.381413] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:09.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c2299cb74bb6562f795e447e","created_at":"2026-09-01T10:39:08.342Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"253f9319e96d0183bfe54cf8aa750486","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:39:08.364Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c2299cb74bb6562f795e447e: start","job_status":"start","queue_duration_s":1.628195,"scheduling_latency_s":1.628217}2518gitlab # [ 459.394906] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c2299cb74bb6562f795e447e","created_at":"2026-09-01T10:39:08.342Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"253f9319e96d0183bfe54cf8aa750486","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:39:08.364Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c2299cb74bb6562f795e447e: done: 0.037915 sec","job_status":"done","queue_duration_s":1.628195,"scheduling_latency_s":1.628217,"redis_calls":9,"redis_duration_s":0.002484,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000535,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037915,"completed_at":"2026-09-01T10:39:10.030Z","load_balancing_strategy":"primary","db_duration_s":0.007103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 459.435150] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a2cfebbb6e60fe62553ff694","created_at":"2026-09-01T10:39:08.400Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbbba4bad064681ee97256a6f12d91fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.420Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a2cfebbb6e60fe62553ff694: start","job_status":"start","queue_duration_s":1.61143,"scheduling_latency_s":1.611448}2520gitlab # [ 459.481239] gitaly[894]: time="2026-09-01T10:39:10.255Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TAATCKC025XFK7MK56TG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:40.052" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:10.253" grpc.time_ms=1.672 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2521gitlab # [ 459.519853] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1232522gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.20 seconds)2523gitlab # [ 459.718342] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a2cfebbb6e60fe62553ff694","created_at":"2026-09-01T10:39:08.400Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbbba4bad064681ee97256a6f12d91fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.420Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a2cfebbb6e60fe62553ff694: done: 0.460102 sec","job_status":"done","queue_duration_s":1.61143,"scheduling_latency_s":1.611448,"redis_calls":13,"redis_duration_s":0.003619,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001051,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.07,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.369899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059824,"exclusive_lock_hold_duration_s":0.43225832,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.460102,"completed_at":"2026-09-01T10:39:10.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.109894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2524gitlab # [ 459.831736] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"45ea21164e24d6557365be10","created_at":"2026-09-01T10:39:08.439Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4b7544fc031fa7a4897a1528559eb89","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.460Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-45ea21164e24d6557365be10: start","job_status":"start","queue_duration_s":2.033516,"scheduling_latency_s":2.033539}2525gitlab # [ 459.854374] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"45ea21164e24d6557365be10","created_at":"2026-09-01T10:39:08.439Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4b7544fc031fa7a4897a1528559eb89","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.460Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-45ea21164e24d6557365be10: done: 0.08544 sec","job_status":"done","queue_duration_s":2.033516,"scheduling_latency_s":2.033539,"redis_calls":11,"redis_duration_s":0.004803999999999999,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000797,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00160066,"exclusive_lock_hold_duration_s":0.03006416,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.08544,"completed_at":"2026-09-01T10:39:10.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2526gitlab # [ 459.904120] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"96f7971ab221deb1f0f7f72c","created_at":"2026-09-01T10:39:08.494Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1002ca3d91abed3e3ba3b5003198f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.516Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-96f7971ab221deb1f0f7f72c: start","job_status":"start","queue_duration_s":2.066174,"scheduling_latency_s":2.066214}2527gitlab # [ 459.918510] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"96f7971ab221deb1f0f7f72c","created_at":"2026-09-01T10:39:08.494Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1002ca3d91abed3e3ba3b5003198f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.516Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-96f7971ab221deb1f0f7f72c: done: 0.051788 sec","job_status":"done","queue_duration_s":2.066174,"scheduling_latency_s":2.066214,"redis_calls":11,"redis_duration_s":0.004255,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001703,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051788,"completed_at":"2026-09-01T10:39:10.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2528gitlab # [ 459.960218] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8a861dfdff4a395dd43924d6","created_at":"2026-09-01T10:39:08.554Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.573Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8a861dfdff4a395dd43924d6: start","job_status":"start","queue_duration_s":2.063739,"scheduling_latency_s":2.063768}2529gitlab # [ 459.974399] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8a861dfdff4a395dd43924d6","created_at":"2026-09-01T10:39:08.554Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.573Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8a861dfdff4a395dd43924d6: done: 0.058738 sec","job_status":"done","queue_duration_s":2.063739,"scheduling_latency_s":2.063768,"redis_calls":18,"redis_duration_s":0.005744,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001064,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000562,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003164,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058738,"completed_at":"2026-09-01T10:39:10.695Z","load_balancing_strategy":"primary","db_duration_s":0.003293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2530gitlab # [ 460.016621] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"11689570fd3b3420e9541931","created_at":"2026-09-01T10:39:08.609Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0dddf4bb0be9101d849ad69b020846f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.629Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-11689570fd3b3420e9541931: start","job_status":"start","queue_duration_s":2.067761,"scheduling_latency_s":2.067786}2531gitlab # [ 460.030983] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"11689570fd3b3420e9541931","created_at":"2026-09-01T10:39:08.609Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0dddf4bb0be9101d849ad69b020846f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.629Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-11689570fd3b3420e9541931: done: 0.052625 sec","job_status":"done","queue_duration_s":2.067761,"scheduling_latency_s":2.067786,"redis_calls":11,"redis_duration_s":0.002224,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076326,"exclusive_lock_hold_duration_s":0.02394156,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.052625,"completed_at":"2026-09-01T10:39:10.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2532gitlab # [ 460.075817] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3b41220d082a87418fe0fcc5","created_at":"2026-09-01T10:39:08.678Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6525d1b50e5aaa1dca406f93a03e5cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.697Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3b41220d082a87418fe0fcc5: start","job_status":"start","queue_duration_s":2.054769,"scheduling_latency_s":2.054793}2533gitlab # [ 460.090855] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3b41220d082a87418fe0fcc5","created_at":"2026-09-01T10:39:08.678Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6525d1b50e5aaa1dca406f93a03e5cd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.697Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3b41220d082a87418fe0fcc5: done: 0.021101 sec","job_status":"done","queue_duration_s":2.054769,"scheduling_latency_s":2.054793,"redis_calls":9,"redis_duration_s":0.001338,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021101,"completed_at":"2026-09-01T10:39:10.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2534gitlab # [ 460.132997] nix-daemon[3927]: accepted connection from pid 4604, user nixbot2535gitlab # [ 460.133929] nix-daemon[3927]: accepted connection from pid 4567, user nixbot2536gitlab # [ 460.134852] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3065c67bd958ae4d4f15d3ba","created_at":"2026-09-01T10:39:08.929Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e94ff33405d078c9d140c546a75b9e99","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.960Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3065c67bd958ae4d4f15d3ba: start","job_status":"start","queue_duration_s":1.813809,"scheduling_latency_s":1.813833}2537gitlab # [ 460.148683] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3065c67bd958ae4d4f15d3ba","created_at":"2026-09-01T10:39:08.929Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e94ff33405d078c9d140c546a75b9e99","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:08.960Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3065c67bd958ae4d4f15d3ba: done: 0.02697 sec","job_status":"done","queue_duration_s":1.813809,"scheduling_latency_s":1.813833,"redis_calls":9,"redis_duration_s":0.001469,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02697,"completed_at":"2026-09-01T10:39:10.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2538gitlab # [ 460.191194] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c9df02af397ae403975a8875","created_at":"2026-09-01T10:39:09.012Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"055880190bcf0fcb7241982b4ae10ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:39:09.032Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c9df02af397ae403975a8875: start","job_status":"start","queue_duration_s":1.770327,"scheduling_latency_s":1.77035}2539gitlab # [ 460.204360] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.815Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2540gitlab # [ 460.207531] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c9df02af397ae403975a8875","created_at":"2026-09-01T10:39:09.012Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"055880190bcf0fcb7241982b4ae10ca1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:39:09.032Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c9df02af397ae403975a8875: done: 0.019488 sec","job_status":"done","queue_duration_s":1.770327,"scheduling_latency_s":1.77035,"redis_calls":9,"redis_duration_s":0.001335,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019488,"completed_at":"2026-09-01T10:39:10.821Z","load_balancing_strategy":"primary","db_duration_s":0.000685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2541gitlab # [ 460.248166] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ba3bd04eaf1a8693a1e76ea1","created_at":"2026-09-01T10:39:09.053Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8611e79537dc21f4db477eb1100b4b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.074Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ba3bd04eaf1a8693a1e76ea1: start","job_status":"start","queue_duration_s":1.748833,"scheduling_latency_s":1.748856}2542gitlab # [ 460.262531] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.838Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2543gitlab # [ 460.266366] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ba3bd04eaf1a8693a1e76ea1","created_at":"2026-09-01T10:39:09.053Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8611e79537dc21f4db477eb1100b4b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.074Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ba3bd04eaf1a8693a1e76ea1: done: 0.034408 sec","job_status":"done","queue_duration_s":1.748833,"scheduling_latency_s":1.748856,"redis_calls":9,"redis_duration_s":0.006199,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034408,"completed_at":"2026-09-01T10:39:10.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2544gitlab # [ 460.308124] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3dac23a3e3a73e9b27e02f31","created_at":"2026-09-01T10:39:09.155Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad4dde914083d3abfb9ce86110de82f9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.178Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3dac23a3e3a73e9b27e02f31: start","job_status":"start","queue_duration_s":1.680559,"scheduling_latency_s":1.680583}2545gitlab # [ 460.322118] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3dac23a3e3a73e9b27e02f31","created_at":"2026-09-01T10:39:09.155Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad4dde914083d3abfb9ce86110de82f9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.178Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3dac23a3e3a73e9b27e02f31: done: 0.027787 sec","job_status":"done","queue_duration_s":1.680559,"scheduling_latency_s":1.680583,"redis_calls":9,"redis_duration_s":0.002305,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027787,"completed_at":"2026-09-01T10:39:10.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 460.363277] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"720841c5ef67b5f5476b20c2","created_at":"2026-09-01T10:39:09.199Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04deaf00e8efd6d8cf60a0297556ea42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.222Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-720841c5ef67b5f5476b20c2: start","job_status":"start","queue_duration_s":1.666172,"scheduling_latency_s":1.666195}2547gitlab # [ 460.378553] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.901Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2548gitlab # [ 460.382137] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"720841c5ef67b5f5476b20c2","created_at":"2026-09-01T10:39:09.199Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-b1d0b43456224290","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04deaf00e8efd6d8cf60a0297556ea42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.222Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-720841c5ef67b5f5476b20c2: done: 0.020611 sec","job_status":"done","queue_duration_s":1.666172,"scheduling_latency_s":1.666195,"redis_calls":9,"redis_duration_s":0.0023090000000000003,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020611,"completed_at":"2026-09-01T10:39:10.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2549gitlab # [ 460.424407] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05056c4443cc8bcaeaea21a2","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05056c4443cc8bcaeaea21a2: start","job_status":"start","queue_duration_s":0.965545,"scheduling_latency_s":0.965567}2550gitlab # [ 460.436374] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05056c4443cc8bcaeaea21a2","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05056c4443cc8bcaeaea21a2: done: 0.031772 sec","job_status":"done","queue_duration_s":0.965545,"scheduling_latency_s":0.965567,"redis_calls":15,"redis_duration_s":0.004032,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031772,"completed_at":"2026-09-01T10:39:10.942Z","load_balancing_strategy":"primary","db_duration_s":0.00068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2551gitlab # [ 460.475958] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cbc4ee7234f7815fed6c89","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cbc4ee7234f7815fed6c89: start","job_status":"start","queue_duration_s":1.000462,"scheduling_latency_s":1.000508}2552gitlab # [ 460.488092] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cbc4ee7234f7815fed6c89","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cbc4ee7234f7815fed6c89: done: 0.038724 sec","job_status":"done","queue_duration_s":1.000462,"scheduling_latency_s":1.000508,"redis_calls":13,"redis_duration_s":0.003772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038724,"completed_at":"2026-09-01T10:39:10.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2553gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2554gitlab # [ 460.526352] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:10.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9dbe737005a324c430debd","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9dbe737005a324c430debd: start","job_status":"start","queue_duration_s":1.042889,"scheduling_latency_s":1.042946}2555gitlab # [ 460.538097] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9dbe737005a324c430debd","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9dbe737005a324c430debd: done: 0.033763 sec","job_status":"done","queue_duration_s":1.042889,"scheduling_latency_s":1.042946,"redis_calls":13,"redis_duration_s":0.0055580000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033763,"completed_at":"2026-09-01T10:39:11.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2556gitlab # [ 460.575392] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2931ce6a775577dca2bc470","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2931ce6a775577dca2bc470: start","job_status":"start","queue_duration_s":1.078731,"scheduling_latency_s":1.078761}2557gitlab # [ 460.588918] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2931ce6a775577dca2bc470","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2931ce6a775577dca2bc470: done: 0.025197 sec","job_status":"done","queue_duration_s":1.078731,"scheduling_latency_s":1.078761,"redis_calls":13,"redis_duration_s":0.003467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025197,"completed_at":"2026-09-01T10:39:11.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2558gitlab # [ 460.627830] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1afe3f151a3b111506523353","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1afe3f151a3b111506523353: start","job_status":"start","queue_duration_s":1.105871,"scheduling_latency_s":1.105898}2559gitlab # [ 460.640309] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1afe3f151a3b111506523353","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1afe3f151a3b111506523353: done: 0.021878 sec","job_status":"done","queue_duration_s":1.105871,"scheduling_latency_s":1.105898,"redis_calls":13,"redis_duration_s":0.003295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021878,"completed_at":"2026-09-01T10:39:11.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 460.679309] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bff932d74edba4de5748a2b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bff932d74edba4de5748a2b: start","job_status":"start","queue_duration_s":1.129879,"scheduling_latency_s":1.129898}2561gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.17 seconds)2562gitlab # [ 460.691735] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bff932d74edba4de5748a2b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bff932d74edba4de5748a2b: done: 0.020048 sec","job_status":"done","queue_duration_s":1.129879,"scheduling_latency_s":1.129898,"redis_calls":13,"redis_duration_s":0.003149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020048,"completed_at":"2026-09-01T10:39:11.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2563gitlab # [ 460.730289] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ad864cd8de174ab9df1d1b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ad864cd8de174ab9df1d1b: start","job_status":"start","queue_duration_s":1.151931,"scheduling_latency_s":1.151949}2564gitlab # [ 460.742752] gitaly[894]: time="2026-09-01T10:39:11.438Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TBGGJGDKK6RA696PZV1B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:41.236" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:11.436" grpc.time_ms=1.124 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2565gitlab # [ 460.755841] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 902566gitlab # [ 460.758629] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ad864cd8de174ab9df1d1b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ad864cd8de174ab9df1d1b: done: 0.018911 sec","job_status":"done","queue_duration_s":1.151931,"scheduling_latency_s":1.151949,"redis_calls":13,"redis_duration_s":0.003015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018911,"completed_at":"2026-09-01T10:39:11.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2567gitlab # [ 460.798476] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4e03689c1d372b7ea869d7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4e03689c1d372b7ea869d7: start","job_status":"start","queue_duration_s":1.172715,"scheduling_latency_s":1.172732}2568gitlab # [ 460.810966] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4e03689c1d372b7ea869d7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4e03689c1d372b7ea869d7: done: 0.018081 sec","job_status":"done","queue_duration_s":1.172715,"scheduling_latency_s":1.172732,"redis_calls":13,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018081,"completed_at":"2026-09-01T10:39:11.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2569gitlab # [ 460.850002] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e235022c18b283ef46547d","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e235022c18b283ef46547d: start","job_status":"start","queue_duration_s":1.1928,"scheduling_latency_s":1.192816}2570gitlab # [ 460.862467] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e235022c18b283ef46547d","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e235022c18b283ef46547d: done: 0.016173 sec","job_status":"done","queue_duration_s":1.1928,"scheduling_latency_s":1.192816,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016173,"completed_at":"2026-09-01T10:39:11.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2571gitlab # [ 460.900978] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e588bd5fe98e68844c77b1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e588bd5fe98e68844c77b1: start","job_status":"start","queue_duration_s":1.210643,"scheduling_latency_s":1.210658}2572gitlab # [ 460.913450] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e588bd5fe98e68844c77b1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e588bd5fe98e68844c77b1: done: 0.015898 sec","job_status":"done","queue_duration_s":1.210643,"scheduling_latency_s":1.210658,"redis_calls":13,"redis_duration_s":0.002622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015898,"completed_at":"2026-09-01T10:39:11.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 460.952179] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9df0463a91156f2aedbb2cd","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9df0463a91156f2aedbb2cd: start","job_status":"start","queue_duration_s":1.227955,"scheduling_latency_s":1.227969}2574gitlab # [ 460.964266] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9df0463a91156f2aedbb2cd","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9df0463a91156f2aedbb2cd: done: 0.017423 sec","job_status":"done","queue_duration_s":1.227955,"scheduling_latency_s":1.227969,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017423,"completed_at":"2026-09-01T10:39:11.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2575gitlab # [ 461.003354] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71dd1cf7820ccad3d9217bee","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71dd1cf7820ccad3d9217bee: start","job_status":"start","queue_duration_s":1.246759,"scheduling_latency_s":1.246774}2576gitlab # [ 461.015552] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71dd1cf7820ccad3d9217bee","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71dd1cf7820ccad3d9217bee: done: 0.016623 sec","job_status":"done","queue_duration_s":1.246759,"scheduling_latency_s":1.246774,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016623,"completed_at":"2026-09-01T10:39:11.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2577gitlab # [ 461.054191] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19eceb2ec26db3e6fa505dbf","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19eceb2ec26db3e6fa505dbf: start","job_status":"start","queue_duration_s":1.264751,"scheduling_latency_s":1.264766}2578gitlab # [ 461.066572] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19eceb2ec26db3e6fa505dbf","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19eceb2ec26db3e6fa505dbf: done: 0.01663 sec","job_status":"done","queue_duration_s":1.264751,"scheduling_latency_s":1.264766,"redis_calls":13,"redis_duration_s":0.002818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01663,"completed_at":"2026-09-01T10:39:11.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2579gitlab # [ 461.104929] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eddb869ca552862a6c1ef8e","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eddb869ca552862a6c1ef8e: start","job_status":"start","queue_duration_s":1.282739,"scheduling_latency_s":1.282753}2580gitlab # [ 461.117167] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eddb869ca552862a6c1ef8e","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eddb869ca552862a6c1ef8e: done: 0.01695 sec","job_status":"done","queue_duration_s":1.282739,"scheduling_latency_s":1.282753,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01695,"completed_at":"2026-09-01T10:39:11.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2581gitlab # [ 461.155540] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79f622d576208e1b6f996f4d","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79f622d576208e1b6f996f4d: start","job_status":"start","queue_duration_s":1.301036,"scheduling_latency_s":1.30105}2582gitlab # [ 461.167862] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79f622d576208e1b6f996f4d","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79f622d576208e1b6f996f4d: done: 0.016336 sec","job_status":"done","queue_duration_s":1.301036,"scheduling_latency_s":1.30105,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016336,"completed_at":"2026-09-01T10:39:11.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2583gitlab # [ 461.207395] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad51dbe4206fbf38d18b18cb","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad51dbe4206fbf38d18b18cb: start","job_status":"start","queue_duration_s":1.318677,"scheduling_latency_s":1.318693}2584gitlab # [ 461.219847] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad51dbe4206fbf38d18b18cb","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad51dbe4206fbf38d18b18cb: done: 0.016636 sec","job_status":"done","queue_duration_s":1.318677,"scheduling_latency_s":1.318693,"redis_calls":13,"redis_duration_s":0.003015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016636,"completed_at":"2026-09-01T10:39:11.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2585gitlab # [ 461.258421] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6487a40612e863f085233fa1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6487a40612e863f085233fa1: start","job_status":"start","queue_duration_s":1.337124,"scheduling_latency_s":1.33714}2586gitlab # [ 461.270680] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6487a40612e863f085233fa1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6487a40612e863f085233fa1: done: 0.016317 sec","job_status":"done","queue_duration_s":1.337124,"scheduling_latency_s":1.33714,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016317,"completed_at":"2026-09-01T10:39:11.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2587gitlab # [ 461.309111] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9367131f75f2e6e354b9a8","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9367131f75f2e6e354b9a8: start","job_status":"start","queue_duration_s":1.355089,"scheduling_latency_s":1.355105}2588gitlab # [ 461.321287] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9367131f75f2e6e354b9a8","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9367131f75f2e6e354b9a8: done: 0.017325 sec","job_status":"done","queue_duration_s":1.355089,"scheduling_latency_s":1.355105,"redis_calls":13,"redis_duration_s":0.0033049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017325,"completed_at":"2026-09-01T10:39:11.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2589gitlab # [ 461.359931] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e15e84ac4cfb6ec428924c1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e15e84ac4cfb6ec428924c1: start","job_status":"start","queue_duration_s":1.374283,"scheduling_latency_s":1.374299}2590gitlab # [ 461.372329] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e15e84ac4cfb6ec428924c1","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e15e84ac4cfb6ec428924c1: done: 0.016211 sec","job_status":"done","queue_duration_s":1.374283,"scheduling_latency_s":1.374299,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016211,"completed_at":"2026-09-01T10:39:11.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2591gitlab # [ 461.411528] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43434beca7c0c6ab0d4bc708","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43434beca7c0c6ab0d4bc708: start","job_status":"start","queue_duration_s":1.392071,"scheduling_latency_s":1.392087}2592gitlab # [ 461.424058] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43434beca7c0c6ab0d4bc708","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43434beca7c0c6ab0d4bc708: done: 0.032532 sec","job_status":"done","queue_duration_s":1.392071,"scheduling_latency_s":1.392087,"redis_calls":13,"redis_duration_s":0.005038,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032532,"completed_at":"2026-09-01T10:39:11.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2593gitlab # [ 461.462182] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9060979a7fba52fa66becd54","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9060979a7fba52fa66becd54: start","job_status":"start","queue_duration_s":1.428354,"scheduling_latency_s":1.428397}2594gitlab # [ 461.474463] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9060979a7fba52fa66becd54","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9060979a7fba52fa66becd54: done: 0.034712 sec","job_status":"done","queue_duration_s":1.428354,"scheduling_latency_s":1.428397,"redis_calls":13,"redis_duration_s":0.003067,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034712,"completed_at":"2026-09-01T10:39:11.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2595gitlab # [ 461.512946] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7029bbf7d4a1d5a5520e22d9","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7029bbf7d4a1d5a5520e22d9: start","job_status":"start","queue_duration_s":1.464236,"scheduling_latency_s":1.464263}2596gitlab # [ 461.525176] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7029bbf7d4a1d5a5520e22d9","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7029bbf7d4a1d5a5520e22d9: done: 0.023673 sec","job_status":"done","queue_duration_s":1.464236,"scheduling_latency_s":1.464263,"redis_calls":13,"redis_duration_s":0.002271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023673,"completed_at":"2026-09-01T10:39:11.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2597gitlab # [ 461.564311] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58a6c47670baf681feb3135c","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58a6c47670baf681feb3135c: start","job_status":"start","queue_duration_s":1.489461,"scheduling_latency_s":1.489485}2598gitlab # [ 461.576590] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58a6c47670baf681feb3135c","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58a6c47670baf681feb3135c: done: 0.019559 sec","job_status":"done","queue_duration_s":1.489461,"scheduling_latency_s":1.489485,"redis_calls":13,"redis_duration_s":0.002197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019559,"completed_at":"2026-09-01T10:39:11.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2599gitlab # [ 461.615823] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38cad31b85578de56ffe88b2","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38cad31b85578de56ffe88b2: start","job_status":"start","queue_duration_s":1.510183,"scheduling_latency_s":1.5102}2600gitlab # [ 461.628198] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38cad31b85578de56ffe88b2","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38cad31b85578de56ffe88b2: done: 0.017305 sec","job_status":"done","queue_duration_s":1.510183,"scheduling_latency_s":1.5102,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001403,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017305,"completed_at":"2026-09-01T10:39:11.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2601gitlab # [ 461.666780] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0bd7349ba941f922edb08a","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0bd7349ba941f922edb08a: start","job_status":"start","queue_duration_s":1.528495,"scheduling_latency_s":1.52851}2602gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2603gitlab # [ 461.679296] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0bd7349ba941f922edb08a","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0bd7349ba941f922edb08a: done: 0.013905 sec","job_status":"done","queue_duration_s":1.528495,"scheduling_latency_s":1.52851,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013905,"completed_at":"2026-09-01T10:39:11.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2604gitlab # [ 461.717006] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"327f410f359f2b6445724daf","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-327f410f359f2b6445724daf: start","job_status":"start","queue_duration_s":1.543469,"scheduling_latency_s":1.543486}2605gitlab # [ 461.728319] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"327f410f359f2b6445724daf","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-327f410f359f2b6445724daf: done: 0.014254 sec","job_status":"done","queue_duration_s":1.543469,"scheduling_latency_s":1.543486,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014254,"completed_at":"2026-09-01T10:39:11.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2606gitlab # [ 461.765950] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b82efa85d991ff7cfb37a617","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b82efa85d991ff7cfb37a617: start","job_status":"start","queue_duration_s":1.558727,"scheduling_latency_s":1.558742}2607gitlab # [ 461.778351] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b82efa85d991ff7cfb37a617","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b82efa85d991ff7cfb37a617: done: 0.015074 sec","job_status":"done","queue_duration_s":1.558727,"scheduling_latency_s":1.558742,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015074,"completed_at":"2026-09-01T10:39:11.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2608gitlab # [ 461.817046] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9ea0a0e2e8a5706e88533b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9ea0a0e2e8a5706e88533b: start","job_status":"start","queue_duration_s":1.575242,"scheduling_latency_s":1.575257}2609gitlab # [ 461.830249] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9ea0a0e2e8a5706e88533b","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9ea0a0e2e8a5706e88533b: done: 0.015125 sec","job_status":"done","queue_duration_s":1.575242,"scheduling_latency_s":1.575257,"redis_calls":13,"redis_duration_s":0.00286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015125,"completed_at":"2026-09-01T10:39:11.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2610gitlab # [ 461.869063] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91b5585bc2a3f2c36c45813","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91b5585bc2a3f2c36c45813: start","job_status":"start","queue_duration_s":1.591768,"scheduling_latency_s":1.591784}2611gitlab # [ 461.881197] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91b5585bc2a3f2c36c45813","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91b5585bc2a3f2c36c45813: done: 0.014689 sec","job_status":"done","queue_duration_s":1.591768,"scheduling_latency_s":1.591784,"redis_calls":13,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014689,"completed_at":"2026-09-01T10:39:11.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 461.919251] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"712bb398016b7e6faaddec86","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-712bb398016b7e6faaddec86: start","job_status":"start","queue_duration_s":1.60783,"scheduling_latency_s":1.607845}2613gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.27 seconds)2614gitlab # [ 461.931465] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"712bb398016b7e6faaddec86","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-712bb398016b7e6faaddec86: done: 0.014733 sec","job_status":"done","queue_duration_s":1.60783,"scheduling_latency_s":1.607845,"redis_calls":13,"redis_duration_s":0.002623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014733,"completed_at":"2026-09-01T10:39:11.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2615gitlab # [ 461.969246] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e769eee2eae13683047f03","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e769eee2eae13683047f03: start","job_status":"start","queue_duration_s":1.62392,"scheduling_latency_s":1.623934}2616gitlab # [ 461.981626] gitaly[894]: time="2026-09-01T10:39:12.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TCNQF1N0VZRQR7KXRRQ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:42.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:12.676" grpc.time_ms=1.315 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2617gitlab # [ 461.994401] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1602618gitlab # [ 461.997031] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4e769eee2eae13683047f03","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4e769eee2eae13683047f03: done: 0.015129 sec","job_status":"done","queue_duration_s":1.62392,"scheduling_latency_s":1.623934,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015129,"completed_at":"2026-09-01T10:39:11.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2619gitlab # [ 462.035274] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d9245bd703d6a63d243223","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d9245bd703d6a63d243223: start","job_status":"start","queue_duration_s":1.640392,"scheduling_latency_s":1.640407}2620gitlab # [ 462.048169] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d9245bd703d6a63d243223","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d9245bd703d6a63d243223: done: 0.014926 sec","job_status":"done","queue_duration_s":1.640392,"scheduling_latency_s":1.640407,"redis_calls":13,"redis_duration_s":0.002729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014926,"completed_at":"2026-09-01T10:39:11.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2621gitlab # [ 462.085855] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c89a88f002439ee6d0da47f","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c89a88f002439ee6d0da47f: start","job_status":"start","queue_duration_s":1.656812,"scheduling_latency_s":1.656829}2622gitlab # [ 462.097968] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c89a88f002439ee6d0da47f","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c89a88f002439ee6d0da47f: done: 0.027405 sec","job_status":"done","queue_duration_s":1.656812,"scheduling_latency_s":1.656829,"redis_calls":13,"redis_duration_s":0.004776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003334,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027405,"completed_at":"2026-09-01T10:39:11.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2623gitlab # [ 462.136027] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a8d41ac73dd4812217d4445","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a8d41ac73dd4812217d4445: start","job_status":"start","queue_duration_s":1.687075,"scheduling_latency_s":1.687113}2624gitlab # [ 462.148068] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a8d41ac73dd4812217d4445","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a8d41ac73dd4812217d4445: done: 0.035039 sec","job_status":"done","queue_duration_s":1.687075,"scheduling_latency_s":1.687113,"redis_calls":13,"redis_duration_s":0.0043490000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035039,"completed_at":"2026-09-01T10:39:11.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2625gitlab # [ 462.186127] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc02cd4e3941e68b17ba018","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc02cd4e3941e68b17ba018: start","job_status":"start","queue_duration_s":1.724472,"scheduling_latency_s":1.724502}2626gitlab # [ 462.198026] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc02cd4e3941e68b17ba018","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc02cd4e3941e68b17ba018: done: 0.028449 sec","job_status":"done","queue_duration_s":1.724472,"scheduling_latency_s":1.724502,"redis_calls":13,"redis_duration_s":0.003789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002507,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028449,"completed_at":"2026-09-01T10:39:11.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2627gitlab # [ 462.236798] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"363dd5540d20eeaf09fb1ae8","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-363dd5540d20eeaf09fb1ae8: start","job_status":"start","queue_duration_s":1.754929,"scheduling_latency_s":1.754954}2628gitlab # [ 462.249568] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"363dd5540d20eeaf09fb1ae8","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-363dd5540d20eeaf09fb1ae8: done: 0.021861 sec","job_status":"done","queue_duration_s":1.754929,"scheduling_latency_s":1.754954,"redis_calls":13,"redis_duration_s":0.0033949999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002286,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021861,"completed_at":"2026-09-01T10:39:11.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2629gitlab # [ 462.288487] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cae1402abb385fe1f2f4991","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cae1402abb385fe1f2f4991: start","job_status":"start","queue_duration_s":1.778406,"scheduling_latency_s":1.778425}2630gitlab # [ 462.300273] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cae1402abb385fe1f2f4991","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cae1402abb385fe1f2f4991: done: 0.018528 sec","job_status":"done","queue_duration_s":1.778406,"scheduling_latency_s":1.778425,"redis_calls":13,"redis_duration_s":0.002896,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018528,"completed_at":"2026-09-01T10:39:11.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2631gitlab # [ 462.338580] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af87782f7b75e0e79dc66c80","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af87782f7b75e0e79dc66c80: start","job_status":"start","queue_duration_s":1.798283,"scheduling_latency_s":1.7983}2632gitlab # [ 462.350922] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af87782f7b75e0e79dc66c80","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af87782f7b75e0e79dc66c80: done: 0.015962 sec","job_status":"done","queue_duration_s":1.798283,"scheduling_latency_s":1.7983,"redis_calls":13,"redis_duration_s":0.002881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015962,"completed_at":"2026-09-01T10:39:11.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2633gitlab # [ 462.389300] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1701975c333a9bea63242689","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1701975c333a9bea63242689: start","job_status":"start","queue_duration_s":1.815723,"scheduling_latency_s":1.815739}2634gitlab # [ 462.401465] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1701975c333a9bea63242689","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1701975c333a9bea63242689: done: 0.014941 sec","job_status":"done","queue_duration_s":1.815723,"scheduling_latency_s":1.815739,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-09-01T10:39:11.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2635gitlab # [ 462.439911] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e5aa52f5001b31cb8472414","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e5aa52f5001b31cb8472414: start","job_status":"start","queue_duration_s":1.83205,"scheduling_latency_s":1.832065}2636gitlab # [ 462.452392] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e5aa52f5001b31cb8472414","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e5aa52f5001b31cb8472414: done: 0.015392 sec","job_status":"done","queue_duration_s":1.83205,"scheduling_latency_s":1.832065,"redis_calls":13,"redis_duration_s":0.003043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015392,"completed_at":"2026-09-01T10:39:11.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2637gitlab # [ 462.491455] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"001dea830b5f713fa04a5952","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-001dea830b5f713fa04a5952: start","job_status":"start","queue_duration_s":1.849,"scheduling_latency_s":1.849015}2638gitlab # [ 462.503393] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"001dea830b5f713fa04a5952","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-001dea830b5f713fa04a5952: done: 0.019752 sec","job_status":"done","queue_duration_s":1.849,"scheduling_latency_s":1.849015,"redis_calls":13,"redis_duration_s":0.002858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019752,"completed_at":"2026-09-01T10:39:11.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2639gitlab # [ 462.541741] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94220e80edb3ea1bdd4e9e64","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94220e80edb3ea1bdd4e9e64: start","job_status":"start","queue_duration_s":1.872574,"scheduling_latency_s":1.872614}2640gitlab # [ 462.554177] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94220e80edb3ea1bdd4e9e64","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94220e80edb3ea1bdd4e9e64: done: 0.037633 sec","job_status":"done","queue_duration_s":1.872574,"scheduling_latency_s":1.872614,"redis_calls":13,"redis_duration_s":0.004508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00283,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037633,"completed_at":"2026-09-01T10:39:11.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2641gitlab # [ 462.592230] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5983889966a6d8eb787b513","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5983889966a6d8eb787b513: start","job_status":"start","queue_duration_s":1.912846,"scheduling_latency_s":1.912878}2642gitlab # [ 462.604374] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5983889966a6d8eb787b513","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5983889966a6d8eb787b513: done: 0.027358 sec","job_status":"done","queue_duration_s":1.912846,"scheduling_latency_s":1.912878,"redis_calls":13,"redis_duration_s":0.003698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002424,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027358,"completed_at":"2026-09-01T10:39:11.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2643gitlab # [ 462.642752] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"409c9b80327d5ec3e33b1feb","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-409c9b80327d5ec3e33b1feb: start","job_status":"start","queue_duration_s":1.942014,"scheduling_latency_s":1.942035}2644gitlab # [ 462.655196] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"409c9b80327d5ec3e33b1feb","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-409c9b80327d5ec3e33b1feb: done: 0.026081 sec","job_status":"done","queue_duration_s":1.942014,"scheduling_latency_s":1.942035,"redis_calls":13,"redis_duration_s":0.003764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002327,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026081,"completed_at":"2026-09-01T10:39:11.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2645gitlab # [ 462.694498] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba6fabdd516ea73bc1688d26","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba6fabdd516ea73bc1688d26: start","job_status":"start","queue_duration_s":1.971438,"scheduling_latency_s":1.971476}2646gitlab # [ 462.706752] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba6fabdd516ea73bc1688d26","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba6fabdd516ea73bc1688d26: done: 0.036936 sec","job_status":"done","queue_duration_s":1.971438,"scheduling_latency_s":1.971476,"redis_calls":13,"redis_duration_s":0.004510999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036936,"completed_at":"2026-09-01T10:39:11.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2647gitlab # [ 462.744783] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a0f48be6c1eb41283590f97","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a0f48be6c1eb41283590f97: start","job_status":"start","queue_duration_s":2.011092,"scheduling_latency_s":2.011125}2648gitlab # [ 462.756637] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a0f48be6c1eb41283590f97","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a0f48be6c1eb41283590f97: done: 0.028335 sec","job_status":"done","queue_duration_s":2.011092,"scheduling_latency_s":2.011125,"redis_calls":13,"redis_duration_s":0.003774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028335,"completed_at":"2026-09-01T10:39:11.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2649gitlab # [ 462.794791] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:11.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef65ebfd63aad9fda56a6fb7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef65ebfd63aad9fda56a6fb7: start","job_status":"start","queue_duration_s":2.04122,"scheduling_latency_s":2.041242}2650gitlab # [ 462.806957] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef65ebfd63aad9fda56a6fb7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef65ebfd63aad9fda56a6fb7: done: 0.020181 sec","job_status":"done","queue_duration_s":2.04122,"scheduling_latency_s":2.041242,"redis_calls":13,"redis_duration_s":0.003082,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020181,"completed_at":"2026-09-01T10:39:12.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2651gitlab # [ 462.845599] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455eaf455fa5657b346c5e26","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455eaf455fa5657b346c5e26: start","job_status":"start","queue_duration_s":2.062979,"scheduling_latency_s":2.062996}2652gitlab # [ 462.857782] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455eaf455fa5657b346c5e26","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455eaf455fa5657b346c5e26: done: 0.017597 sec","job_status":"done","queue_duration_s":2.062979,"scheduling_latency_s":2.062996,"redis_calls":13,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017597,"completed_at":"2026-09-01T10:39:12.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2653gitlab # [ 462.897792] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbd81b315ccbfa15283d1b5f","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbd81b315ccbfa15283d1b5f: start","job_status":"start","queue_duration_s":2.082003,"scheduling_latency_s":2.082019}2654gitlab # [ 462.910243] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbd81b315ccbfa15283d1b5f","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbd81b315ccbfa15283d1b5f: done: 0.015578 sec","job_status":"done","queue_duration_s":2.082003,"scheduling_latency_s":2.082019,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015578,"completed_at":"2026-09-01T10:39:12.043Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2655gitlab # [ 462.948487] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71b1875de5382e36cdaad9d7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71b1875de5382e36cdaad9d7: start","job_status":"start","queue_duration_s":2.098926,"scheduling_latency_s":2.098941}2656gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2657gitlab # [ 462.960781] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71b1875de5382e36cdaad9d7","created_at":"2026-09-01T10:39:09.840Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-acd48a73b3d54d57","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"88b30fb059040e3944dbd35fc88c77dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:09.945Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71b1875de5382e36cdaad9d7: done: 0.014604 sec","job_status":"done","queue_duration_s":2.098926,"scheduling_latency_s":2.098941,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014604,"completed_at":"2026-09-01T10:39:12.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2658gitlab # [ 462.997249] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.060Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a71c4d6195e93e804becc82d","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a71c4d6195e93e804becc82d: start","job_status":"start","queue_duration_s":1.37973,"scheduling_latency_s":1.379744}2659gitlab # [ 463.008422] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.077Z","message":"No existing merge request to be cleaned up."}2660gitlab # [ 463.009929] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.094Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a71c4d6195e93e804becc82d","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a71c4d6195e93e804becc82d: done: 0.033814 sec","job_status":"done","queue_duration_s":1.37973,"scheduling_latency_s":1.379744,"redis_calls":12,"redis_duration_s":0.003121,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033814,"completed_at":"2026-09-01T10:39:12.094Z","load_balancing_strategy":"primary","db_duration_s":0.006369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2661gitlab # [ 463.049358] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.095Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df86d54d29f03bfd64ef7d72","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df86d54d29f03bfd64ef7d72: start","job_status":"start","queue_duration_s":1.415194,"scheduling_latency_s":1.415214}2662gitlab # [ 463.061222] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.109Z","message":"No existing merge request to be cleaned up."}2663gitlab # [ 463.062895] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.119Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df86d54d29f03bfd64ef7d72","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df86d54d29f03bfd64ef7d72: done: 0.023869 sec","job_status":"done","queue_duration_s":1.415194,"scheduling_latency_s":1.415214,"redis_calls":10,"redis_duration_s":0.002709,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023869,"completed_at":"2026-09-01T10:39:12.119Z","load_balancing_strategy":"primary","db_duration_s":0.002893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2664gitlab # [ 463.101391] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.121Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e008ff7319a2d83b4259fe4a","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e008ff7319a2d83b4259fe4a: start","job_status":"start","queue_duration_s":1.440744,"scheduling_latency_s":1.440766}2665gitlab # [ 463.113235] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.134Z","message":"No existing merge request to be cleaned up."}2666gitlab # [ 463.114850] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.145Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e008ff7319a2d83b4259fe4a","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e008ff7319a2d83b4259fe4a: done: 0.024145 sec","job_status":"done","queue_duration_s":1.440744,"scheduling_latency_s":1.440766,"redis_calls":10,"redis_duration_s":0.002649,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024145,"completed_at":"2026-09-01T10:39:12.145Z","load_balancing_strategy":"primary","db_duration_s":0.004693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2667gitlab # [ 463.152296] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.147Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5017ea03139fd8dcf433e8c8","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5017ea03139fd8dcf433e8c8: start","job_status":"start","queue_duration_s":1.466445,"scheduling_latency_s":1.466462}2668gitlab # [ 463.164409] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.159Z","message":"No existing merge request to be cleaned up."}2669gitlab # [ 463.166115] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:12.168Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5017ea03139fd8dcf433e8c8","created_at":"2026-09-01T10:39:10.660Z","trace_propagation_headers":{"sentry-trace":"56f416eb75bf43678fa59a7c4e1e9aa8-db4ef12998d340bd","baggage":"sentry-trace_id=56f416eb75bf43678fa59a7c4e1e9aa8,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30db01b8bf0f60d19e483618bffe10b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:10.680Z","job_size_bytes":2,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5017ea03139fd8dcf433e8c8: done: 0.021476 sec","job_status":"done","queue_duration_s":1.466445,"scheduling_latency_s":1.466462,"redis_calls":10,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001443,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021476,"completed_at":"2026-09-01T10:39:12.168Z","load_balancing_strategy":"primary","db_duration_s":0.002662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2670gitlab # [ 463.204500] gitaly[894]: time="2026-09-01T10:39:13.939Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TDXCC11AQXNYY5800QAB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:43.537" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:13.938" grpc.time_ms=1.198 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2671gitlab # [ 463.225237] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1622672gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.27 seconds)2673gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2674gitlab # [ 464.403366] gitaly[894]: time="2026-09-01T10:39:15.176Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TF3PT51D31TJG98RGTJC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:45.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:15.175" grpc.time_ms=1.201 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2675gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.23 seconds)2676gitlab # [ 464.460559] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1702677gitlab # [ 464.483863] nix-daemon[3927]: accepted connection from pid 4567, user nixbot2678gitlab # [ 464.660554] gitaly[894]: time="2026-09-01T10:39:15.434Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:45.232" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:15.433" grpc.time_ms=1.237 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2679gitlab # [ 464.736296] gitaly[894]: time="2026-09-01T10:39:15.510Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:25.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.493" grpc.time_ms=17.386 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2680gitlab # [ 464.816759] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:15.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b345ceb8bb38ef414fe441b4","created_at":"2026-09-01T10:39:15.578Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-aa6081789ade4885","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:15.586Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b345ceb8bb38ef414fe441b4: start","job_status":"start","queue_duration_s":0.002921,"scheduling_latency_s":0.002984}2681gitlab # [ 464.862889] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2892682gitlab # [ 464.870177] nixbot[3690]: {"ts": "2026-09-01T10:39:15.617Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa \"HTTP/1.1 201 Created\""}2683gitlab # [ 464.941390] gitaly[894]: time="2026-09-01T10:39:15.715Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFNAD3ZYR74BGRBEZ7E4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:45.513" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:15.714" grpc.time_ms=1.24 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2684gitlab # [ 465.046515] gitaly[894]: time="2026-09-01T10:39:15.820Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFNAD3ZYR74BGRBEZ7E4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:25.129" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.800" grpc.time_ms=19.972 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2685gitlab # [ 465.090272] gitaly[894]: time="2026-09-01T10:39:15.864Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:15.863" grpc.time_ms=0.87 pid=894 span.kind=server system=grpc2686gitlab # [ 465.157915] gitaly[894]: time="2026-09-01T10:39:15.932Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:15.931" grpc.time_ms=1.05 pid=894 span.kind=server system=grpc2687gitlab # [ 465.180189] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3152688gitlab # [ 465.185343] nixbot[3690]: {"ts": "2026-09-01T10:39:15.943Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa \"HTTP/1.1 201 Created\""}2689gitlab # [ 465.206062] gitaly[894]: time="2026-09-01T10:39:15.980Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:15.979" grpc.time_ms=0.805 pid=894 span.kind=server system=grpc2690gitlab # [ 465.228255] gitaly[894]: time="2026-09-01T10:39:15.990Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" operations="[repack_refs]" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2691gitlab # [ 465.247053] gitaly[894]: time="2026-09-01T10:39:15.996Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" pid=894 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-01 10:37:23.5527454 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2692gitlab # [ 465.265864] gitaly[894]: time="2026-09-01T10:39:15.997Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ diskcache=3fbae480-6ab6-4ca9-975a-b57506f0598a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2693gitlab # [ 465.279811] gitaly[894]: time="2026-09-01T10:39:15.998Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=186 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7307 command.oublock=0 command.real_time_ms=204 command.spawn_token_fork_ms=1 command.system_time_ms=99 command.user_time_ms=87 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" grpc.time_ms=214.631 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2694gitlab # [ 465.297382] gitaly[894]: time="2026-09-01T10:39:16.033Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" pid=894 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2695gitlab # [ 465.312196] gitaly[894]: time="2026-09-01T10:39:16.033Z" level=info msg="optimized repository" clean_stale_data_time=36.62552ms clean_work_trees_time="127.32µs" commit_graph_time=940ns correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.04µs" pid=894 prune_time=320ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.54µs" storage_name=default system=housekeeping total_time=36.81402ms2696gitlab # [ 465.318223] gitaly[894]: time="2026-09-01T10:39:16.033Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:45.782" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:15.783" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2697gitlab # [ 465.327810] gitaly[894]: time="2026-09-01T10:39:16.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TG058YBNVQSN45FSGJ2D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:46.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:16.072" grpc.time_ms=2.366 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2698gitlab # [ 465.341776] gitaly[894]: time="2026-09-01T10:39:16.107Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:46.104" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:16.105" grpc.time_ms=1.571 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2699gitlab # [ 465.392995] gitaly[894]: time="2026-09-01T10:39:16.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TG058YBNVQSN45FSGJ2D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:26.143" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:16.154" grpc.time_ms=13.07 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2700gitlab # [ 465.412371] gitaly[894]: time="2026-09-01T10:39:16.170Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TFBXGX7FPTJ1TRZ7XNAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:46.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:16.169" grpc.time_ms=1.086 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2701gitlab # [ 465.427523] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.201Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9385912be901358525e56256","created_at":"2026-09-01T10:39:16.192Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b345ceb8bb38ef414fe441b4","job_size_bytes":3,"pid":3631,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9385912be901358525e56256: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2702gitlab # [ 465.444198] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.205Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b345ceb8bb38ef414fe441b4","created_at":"2026-09-01T10:39:15.578Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-aa6081789ade4885","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:15.586Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3631,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b345ceb8bb38ef414fe441b4: rescheduled"}2703gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses2704gitlab # [ 465.458786] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.218Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b345ceb8bb38ef414fe441b4","created_at":"2026-09-01T10:39:15.578Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-aa6081789ade4885","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:15.586Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b345ceb8bb38ef414fe441b4: done: 0.629083 sec","job_status":"done","queue_duration_s":0.002921,"scheduling_latency_s":0.002984,"gitaly_calls":3,"gitaly_duration_s":0.232088,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.035499,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002121,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003039,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00653,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.013578,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000573,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000446,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007091,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.311545,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.51564052,"duration_s":0.629083,"completed_at":"2026-09-01T10:39:16.218Z","load_balancing_strategy":"primary","db_duration_s":0.070509,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2705gitlab # [ 465.508174] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2a9c6a5807f38e4c1c4de08b","created_at":"2026-09-01T10:39:15.762Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:15.768Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2a9c6a5807f38e4c1c4de08b: start","job_status":"start","queue_duration_s":0.45289,"scheduling_latency_s":0.45292}2706gitlab # [ 465.524489] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3092707gitlab # [ 465.526966] nixbot[3690]: {"ts": "2026-09-01T10:39:16.287Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa \"HTTP/1.1 201 Created\""}2708gitlab # [ 465.556405] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2a9c6a5807f38e4c1c4de08b","created_at":"2026-09-01T10:39:15.762Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:15.768Z","job_size_bytes":23,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2a9c6a5807f38e4c1c4de08b: done: 0.108352 sec","job_status":"done","queue_duration_s":0.45289,"scheduling_latency_s":0.45292,"redis_calls":7,"redis_duration_s":0.003818,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.108352,"completed_at":"2026-09-01T10:39:16.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022867,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2709gitlab # [ 465.603059] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.336Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e03de83600b92b42339ed115","created_at":"2026-09-01T10:39:16.014Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:16.019Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e03de83600b92b42339ed115: start","job_status":"start","queue_duration_s":0.316553,"scheduling_latency_s":0.316592}2710gitlab # [ 465.619658] gitaly[894]: time="2026-09-01T10:39:16.377Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TGAFAZXCM55D6576S8Q3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:46.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:16.376" grpc.time_ms=0.676 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2711gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/25be9462d5ccd5b2da5c349a8d71cb36504f3bfa/statuses, in 0.20 seconds)2712(finished: subtest: eval and build post commit statuses, in 11.17 seconds)2713(finished: run the VM test script, in 539.32 seconds)2714gitlab # [ 465.633879] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.407Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e03de83600b92b42339ed115","created_at":"2026-09-01T10:39:16.014Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:16.019Z","job_size_bytes":3,"pid":3631,"sidekiq_tid":"m8uf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e03de83600b92b42339ed115: done: 0.071506 sec","job_status":"done","queue_duration_s":0.316553,"scheduling_latency_s":0.316592,"redis_calls":7,"redis_duration_s":0.0055580000000000004,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071506,"completed_at":"2026-09-01T10:39:16.407Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2715test script finished in 539.35s2716cleanup2717kill QemuMachine (pid 46)2718gitlab # [ 465.678144] sidekiq-cluster[3631]: {"severity":"INFO","time":"2026-09-01T10:39:16.409Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c7e874251c320980d58cfd44","created_at":"2026-09-01T10:39:16.029Z","trace_propagation_headers":{"sentry-trace":"c90d7b7ea912466b92b03e3088596a42-77e21754e79b4fb4","baggage":"sentry-trace_id=c90d7b7ea912466b92b03e3088596a42,sentry-release=Unknown"},"correlation_id":"01M1E8TFBXGX7FPTJ1TRZ7XNAJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated",qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2719(finished: cleanup, in 1.98 seconds)2720additionally exposed symbols:2721 gitlab,2722 vlan1,2723 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2724[]2725[]2726[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-01T10:37:33.172Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2727[]2728[]2729[]2730[]2731[]2732[]2733[]2734[]2735[]2736[]2737[]2738[]2739[]2740[]2741[]2742[]2743[]2744[]2745[]2746[]2747[]2748[]2749[]2750[]2751[]2752[]2753[]2754[]2755[]2756[]2757[]2758[]2759[]2760[]2761[]2762[]2763[]2764[]2765[]2766[]2767[]2768[]2769[]2770[]2771[]2772[]2773[]2774[]2775[]2776[]2777[]2778[]2779[]2780[]2781[]2782[]2783[]2784[]2785[]2786[]2787[]2788[]2789[]2790[]2791[]2792[]2793[]2794[]2795[]2796[]2797[]2798[]2799[]2800[]2801[]2802[]2803[]2804[]2805[]2806[]2807[]2808[]2809[]2810[]2811[]2812[]2813[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-01T10:39:05.099362Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2814[]2815[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2816[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2817[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2818[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2819[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2820[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2821[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2822[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2823[{'id': 5, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-01T10:39:05.646Z', 'started_at': None, 'finished_at': '2026-09-01T10:39:15.559Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '25be9462d5ccd5b2da5c349a8d71cb36504f3bfa', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-01T10:39:15.879Z', 'started_at': None, 'finished_at': '2026-09-01T10:39:16.228Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]